00000001:02000400:3.0F:1788200962.115922:0:2967:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788200970.387049:0:3169:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1788200971.202428:0:3210:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1335 MB/s 00000001:01000000:0.0:1788200971.452448:0:3210:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1643 MB/s 00000001:01000000:0.0:1788200971.702200:0:3210:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10503 MB/s 00000020:02000000:0.0:1788200971.982522:0:3261:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.56_54_gb664824 00000400:02000000:0.0:1788200972.347382:0:3276:0:(api-ni.c:2822:lnet_startup_lndni()) Added LNI 192.168.203.114@tcp [8/256/0/180] 00008000:02000000:1.0F:1788200974.698255:0:3426:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788201014.554776:0:5224:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788201022.831880:0:5808:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788201022.831885:0:5808:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788201022.832013:0:5808:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000002f4aac69 00000080:02000400:3.0:1788201022.832023:0:5808:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788201022.836591:0:5808:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788201022.836605:0:5808:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788201022.836640:0:5808:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a426fa76) 00000020:00000080:3.0:1788201022.836664:0:5808:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788201022.850243:0:5808:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788201022.850770:0:5808:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788201022.878635:0:5808:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788201022.878678:0:5808:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788201022.878700:0:5808:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788201022.878757:0:5808:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788201022.878785:0:5808:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788201022.879611:0:5808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788201022.879620:0:5808:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788201022.879630:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72011f792b7867bb 00000020:01000004:0.0:1788201022.879637:0:5808:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788201022.879642:0:5808:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788201022.879647:0:5808:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002f4aac69 from MGS 00000020:01000004:0.0:1788201022.879651:0:5808:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788201022.879669:0:5808:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000108128c0) 00000020:00000080:0.0:1788201022.879679:0:5808:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788201022.880017:0:5808:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002f4aac69 from MGS, refs=2 00080000:01000000:0.0:1788201022.880025:0:5808:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788201022.880032:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72011f792b7867c9 00000100:00100000:0.0:1788201022.880448:0:5808:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788201022.880575:0:5808:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788201022.880581:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788201022.881270:0:5808:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788201022.881278:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788201022.882942:0:5808:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201022.883110:0:5808:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788201022.883116:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788201022.883795:0:5808:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788201022.883803:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788201022.884124:0:5808:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788201022.884161:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788201022.884770:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201022.884774:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201022.884776:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201022.884937:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201022.884940:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201022.884941:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201022.885633:0:5808:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788201022.894561:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788201023.136548:0:5808:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2521 MB/s 00000001:01000000:0.0:1788201023.386295:0:5808:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3227 MB/s 00000001:01000000:0.0:1788201023.636507:0:5808:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 731 MB/s 00000001:01000000:3.0:1788201023.886585:0:5808:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 699 MB/s 00080000:10000000:3.0:1788201023.892108:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1788201023.916896:0:5808:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788201023.916915:0:5808:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788201023.916917:0:5808:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788201023.917687:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788201023.917747:0:5808:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788201023.917786:0:5808:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788201023.917991:0:5808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788201023.918018:0:5808:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788201023.918708:0:5808:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201023.918845:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788201023.918852:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788201023.922555:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788201023.922568:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788201023.923496:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788201023.923504:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788201023.928640:0:5808:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788201023.928677:0:5808:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.114@tcp' 00000020:01000004:3.0:1788201023.928679:0:5808:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788201023.928728:0:5808:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.114@tcp (typ=mgc) 00000020:00000080:3.0:1788201023.928739:0:5808:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.114@tcp (000000005ca2810a) 00000020:00000080:3.0:1788201023.928754:0:5808:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788201023.928828:0:5808:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004b48c8a2@MGC192.168.203.114@tcp: add connection 192.168.203.114@tcp at head 00010000:00010000:3.0:1788201023.929016:0:5808:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.114@tcp-0 is initialized 00000040:01000000:3.0:1788201023.929022:0:5808:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788201023.929941:0:5823:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788201023.938000:0:5825:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788201023.938108:0:5808:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.114@tcp (uuid 16f590af-689d-4459-b486-809c9db65822) 00000020:00000080:2.0:1788201023.938129:0:5808:0:(genops.c:1406:class_connect()) connect: client 16f590af-689d-4459-b486-809c9db65822, cookie 0x72011f792b7867d7 00000100:00080000:2.0:1788201023.938262:0:5808:0:(import.c:510:import_select_connection()) MGC192.168.203.114@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201023.938268:0:5808:0:(import.c:624:import_select_connection()) MGC192.168.203.114@tcp: import 000000004b48c8a2 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788201023.938309:0:5808:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ed510a55 x1875064622416000/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201023.938329:0:5808:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 16f590af-689d-4459-b486-809c9db65822->MGS 00000020:01000004:2.0:1788201023.938347:0:5808:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788201023.938366:0:5808:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788201023.938387:0:5808:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000007b97ea1c) 00000020:00000080:2.0:1788201023.938400:0:5808:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788201023.938739:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ed510a55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:16f590af-689d-4459-b486-809c9db65822:3291:1875064622416000:0@lo:250: 00000100:00100000:3.0:1788201023.938828:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201023.939173:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622416000 00000100:00100000:1.0:1788201023.939182:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622416000 00000100:00100000:1.0:1788201023.939222:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201023.939228:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd31d10d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3291:x1875064622416000:12345-0@lo:250: 00010000:00080000:1.0:1788201023.939253:0:5819:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 16f590af-689d-4459-b486-809c9db65822@0@lo t0 exp 0000000000000000 cur 103 last 0 00000020:00000080:1.0:1788201023.939290:0:5819:0:(genops.c:1406:class_connect()) connect: client 16f590af-689d-4459-b486-809c9db65822, cookie 0x72011f792b7867e5 00000100:00080000:1.0:1788201023.939546:0:5819:0:(import.c:65:import_set_state_nolock()) 0000000029759690 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201023.939626:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd31d10d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+5:3291:x1875064622416000:12345-0@lo:250: Request processed in 396us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201023.939634:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201023.942881:0:3291:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.114@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788201023.942896:0:3291:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.114@tcp: connect to target with instance 0 00000100:00080000:3.0:1788201023.942904:0:3291:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.114@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788201023.942909:0:3291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788201023.942913:0:3291:0:(import.c:65:import_set_state_nolock()) 000000004b48c8a2 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788201023.942917:0:3291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788201023.942923:0:3291:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788201023.942930:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ed510a55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:16f590af-689d-4459-b486-809c9db65822:3291:1875064622416000:0@lo:250: 00000100:00100000:2.0:1788201023.950047:0:5808:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201023.950350:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788201023.950357:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00010000:00010000:1.0:1788201023.951798:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201023.952768:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788201023.952778:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788201023.954335:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788201023.954346:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788201023.955062:0:5808:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201023.955433:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788201023.955439:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788201023.956105:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788201023.956112:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788201024.002695:0:5808:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201024.002947:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788201024.002970:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788201024.004593:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788201024.004605:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788201024.006509:0:5808:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201024.006672:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788201024.006678:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788201024.007715:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788201024.007724:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788201024.008613:0:5808:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201024.008758:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788201024.008762:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788201024.009540:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788201024.009548:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788201024.010466:0:5808:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201024.010615:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788201024.010619:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788201024.011261:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788201024.011485:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788201024.044923:0:5808:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201024.045319:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788201024.045326:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788201024.046985:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788201024.046996:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788201024.047948:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788201024.047957:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788201024.049685:0:5808:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788201024.049705:0:5808:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788201024.049711:0:5808:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.114@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788201024.049846:0:5808:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788201024.049877:0:5808:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.114@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788201024.049880:0:5808:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788201024.049882:0:5808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201024.049883:0:5808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201024.049883:0:5808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201024.049884:0:5808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201024.049885:0:5808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201024.049885:0:5808:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201024.049886:0:5808:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201024.049887:0:5808:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788201024.049888:0:5808:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788201024.049889:0:5808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201024.049889:0:5808:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201024.049891:0:5808:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788201024.049892:0:5808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201024.049893:0:5808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201024.049893:0:5808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201024.049894:0:5808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201024.049895:0:5808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201024.049895:0:5808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201024.049896:0:5808:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201024.049896:0:5808:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201024.049897:0:5808:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788201024.049897:0:5808:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788201024.049898:0:5808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201024.049898:0:5808:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201024.049918:0:5808:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788201024.049930:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622416128:0@lo:253: 00000100:00100000:2.0:1788201024.050001:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201024.050088:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cdeac51f going to sleep for 11 seconds 00000100:00100000:3.0:1788201024.050193:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622416128 00000100:00100000:3.0:1788201024.050200:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622416128 00000100:00100000:3.0:1788201024.050277:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201024.050286:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000609137f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+5:5808:x1875064622416128:12345-0@lo:253: 20000000:01000000:3.0:1788201024.050326:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788201024.050332:0:5822:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788201024.050628:0:5843:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788201024.050679:0:5822:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788201024.050956:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201024.052977:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788201024.053345:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788201024.053350:0:5822:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788201024.053356:0:5822:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788201024.053359:0:5822:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788201024.053376:0:5822:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788201024.053607:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201024.053836:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788201024.053849:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788201024.053893:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788201024.053936:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788201024.053986:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788201024.054073:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788201024.054081:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788201024.054171:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788201024.054180:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788201024.054213:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788201024.054220:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788201024.054252:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788201024.054301:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788201024.054331:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788201024.054336:0:5822:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788201024.054347:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201024.054521:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788201024.054531:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788201024.054565:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788201024.054599:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788201024.054644:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788201024.054655:0:5822:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788201024.054726:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788201024.054735:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788201024.054781:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788201024.054820:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788201024.054857:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788201024.054868:0:5822:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788201024.054949:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788201024.054958:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788201024.055005:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788201024.055039:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788201024.055236:0:5822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788201024.055283:0:5822:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788201024.055290:0:5822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788201024.056099:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788201024.056468:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788201024.056490:0:5822:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.114@tcp for mdt 20000000:01000000:3.0:1788201024.056492:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.114@tcp (null) (null) (null) 00000040:00080000:3.0:1788201024.056608:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788201024.056616:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788201024.056649:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788201024.056656:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.114@tcp (null) (null) 00000040:00080000:3.0:1788201024.056704:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788201024.056714:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788201024.056748:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788201024.056869:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788201024.056935:0:5822:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788201024.056938:0:5822:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788201024.056943:0:5822:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788201024.056949:0:5822:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788201024.057430:0:5846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1788201024.057628:0:5822:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788201024.067584:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788201024.067636:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1788201024.068216:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1788201024.068239:0:5822:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788201024.068241:0:5822:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788201024.068245:0:5822:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788201024.068257:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788201024.068260:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788201024.068290:0:5822:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788201024.068292:0:5822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788201024.070826:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788201024.071749:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788201024.071866:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788201024.071903:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1788201024.071917:0:5822:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788201024.071919:0:5822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788201024.073634:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1788201024.073949:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1788201024.074004:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1788201024.074067:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:2.0:1788201024.074081:0:5822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788201024.074083:0:5822:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1788201024.074090:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788201024.074109:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000356a00fa/0x72011f792b7867ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.074124:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000356a00fa/0x72011f792b7867ec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.074317:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000356a00fa/0x72011f792b7867ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.074326:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000356a00fa/0x72011f792b7867ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.074332:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000356a00fa/0x72011f792b7867ec lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.074338:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000356a00fa/0x72011f792b7867ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.074357:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000356a00fa already unused, calling callback (000000008e60a636) 00010000:00010000:2.0:1788201024.074360:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000356a00fa/0x72011f792b7867ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.074367:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000356a00fa/0x72011f792b7867ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.074380:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000356a00fa/0x72011f792b7867ec lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.074387:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000356a00fa/0x72011f792b7867ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.074392:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000356a00fa/0x72011f792b7867ec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788201024.074409:0:5822:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788201024.256274:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000609137f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+5:5808:x1875064622416128:12345-0@lo:253: Request processed in 205983us (206266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201024.256303:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201024.256452:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622416128:0@lo:253: 10000000:01000000:2.0:1788201024.256466:0:5808:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788201024.256469:0:5808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201024.256471:0:5808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201024.256473:0:5808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201024.256474:0:5808:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788201024.256475:0:5808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201024.256476:0:5808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201024.256477:0:5808:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201024.256479:0:5808:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201024.256480:0:5808:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788201024.256481:0:5808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201024.256482:0:5808:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788201024.256499:0:5808:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002f4aac69 from lustre-MDT0000 10000000:01000000:2.0:1788201024.256525:0:5808:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788201024.256536:0:5808:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788201024.256539:0:5808:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b000701cd40 10000000:01000000:2.0:1788201024.256544:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201024.256551:0:5808:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b000701cd40 from 1 10000000:01000000:2.0:1788201024.256554:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788201024.256588:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 00000000356a00fa/0x72011f792b7867f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.256598:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 00000000356a00fa/0x72011f792b7867f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.256606:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 00000000356a00fa/0x72011f792b7867f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201024.256624:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622416256:0@lo:101: 00000100:00100000:2.0:1788201024.256655:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201024.256753:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b3b69aff going to sleep for 11 seconds 00000100:00100000:0.0:1788201024.256843:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622416256 00000100:00100000:0.0:1788201024.256850:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622416256 00000100:00100000:0.0:1788201024.256919:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201024.256927:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f81da282 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+5:5808:x1875064622416256:12345-0@lo:101: 00010000:00010000:0.0:1788201024.256939:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201024.256952:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000279ca48e/0x72011f792b7867fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b7867f3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201024.256990:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000279ca48e/0x72011f792b7867fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b7867f3 expref: 6 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201024.256999:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000279ca48e/0x72011f792b7867fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b7867f3 expref: 6 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201024.257008:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000279ca48e, rc 0) 00000100:00100000:0.0:1788201024.257067:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f81da282 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+6:5808:x1875064622416256:12345-0@lo:101: Request processed in 138us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201024.257073:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201024.257130:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622416256:0@lo:101: 00010000:00010000:2.0:1788201024.257168:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 00000000356a00fa/0x72011f792b7867f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7867fa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.257175:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 00000000356a00fa/0x72011f792b7867f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b7867fa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201024.257214:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622416384:0@lo:501: 00000100:00100000:2.0:1788201024.257235:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201024.257481:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b3b69aff going to sleep for 11 seconds 00000100:00100000:1.0:1788201024.257525:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622416384 00000100:00100000:1.0:1788201024.257530:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622416384 00000100:00100000:3.0:1788201024.257566:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201024.257574:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad1ac4b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+6:5808:x1875064622416384:12345-0@lo:501: 00000100:00100000:3.0:1788201024.257808:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad1ac4b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+6:5808:x1875064622416384:12345-0@lo:501: Request processed in 236us (572us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201024.257815:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201024.257892:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622416384:0@lo:501: 10000000:01000000:2.0:1788201024.257917:0:5808:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788201024.257939:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 00000000356a00fa/0x72011f792b7867f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7867fa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.257947:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 00000000356a00fa/0x72011f792b7867f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7867fa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201024.257954:0:5808:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b0007c1d000 10000000:01000000:2.0:1788201024.257957:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788201024.257970:0:5808:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b0007c1d000 10000000:01000000:2.0:1788201024.257973:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788201024.257975:0:5808:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9b0007c1d000 from 1 10000000:01000000:2.0:1788201024.257977:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788201024.257993:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 00000000cc9840db/0x72011f792b786801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.258000:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 00000000cc9840db/0x72011f792b786801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.258007:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 00000000cc9840db/0x72011f792b786801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201024.258018:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622416512:0@lo:101: 00000100:00100000:2.0:1788201024.258045:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201024.258062:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b3b69aff going to sleep for 11 seconds 00000100:00100000:3.0:1788201024.258122:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622416512 00000100:00100000:3.0:1788201024.258126:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622416512 00000100:00100000:3.0:1788201024.258168:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201024.258173:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000945f5211 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+6:5808:x1875064622416512:12345-0@lo:101: 00010000:00010000:3.0:1788201024.258181:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201024.258191:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000017391982/0x72011f792b786808 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786801 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.258203:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000017391982/0x72011f792b786808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786801 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.258210:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000017391982/0x72011f792b786808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786801 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.258216:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000017391982, rc 0) 00000100:00100000:3.0:1788201024.258239:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000945f5211 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+7:5808:x1875064622416512:12345-0@lo:101: Request processed in 67us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201024.258244:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201024.258307:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622416512:0@lo:101: 00010000:00010000:2.0:1788201024.258317:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 00000000cc9840db/0x72011f792b786801 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786808 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.258398:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 00000000cc9840db/0x72011f792b786801 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786808 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201024.258424:0:5808:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788201024.258433:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 00000000cc9840db/0x72011f792b786801 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786808 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.258438:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 00000000cc9840db/0x72011f792b786801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786808 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201024.258443:0:5808:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788201024.258446:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201024.258450:0:5808:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b0007c1d000 10000000:01000000:2.0:1788201024.258453:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788201024.258455:0:5808:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788201024.258457:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201024.258470:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 000000008ccd5161/0x72011f792b78680f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.258475:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 000000008ccd5161/0x72011f792b78680f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.258482:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 000000008ccd5161/0x72011f792b78680f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201024.258492:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622416640:0@lo:101: 00000100:00100000:2.0:1788201024.258515:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201024.258543:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b3b69aff going to sleep for 11 seconds 00000100:00100000:0.0:1788201024.258576:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622416640 00000100:00100000:0.0:1788201024.258580:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622416640 00000100:00100000:0.0:1788201024.258637:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788201024.258644:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8c8e4e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+7:5808:x1875064622416640:12345-0@lo:101: 00010000:00010000:0.0:1788201024.258652:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201024.258659:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004e95518d/0x72011f792b786816 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b78680f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201024.258679:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004e95518d/0x72011f792b786816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b78680f expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201024.258687:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004e95518d/0x72011f792b786816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b78680f expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201024.258761:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004e95518d, rc 0) 00000100:00100000:0.0:1788201024.258841:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8c8e4e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+8:5808:x1875064622416640:12345-0@lo:101: Request processed in 198us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201024.258846:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201024.258901:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622416640:0@lo:101: 00010000:00010000:2.0:1788201024.258910:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 000000008ccd5161/0x72011f792b78680f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786816 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.258927:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 000000008ccd5161/0x72011f792b78680f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786816 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201024.258975:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622416768:0@lo:501: 00000100:00100000:2.0:1788201024.258999:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201024.259055:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b3b69aff going to sleep for 11 seconds 00000100:00100000:1.0:1788201024.259106:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622416768 00000100:00100000:1.0:1788201024.259110:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622416768 00000100:00100000:1.0:1788201024.259166:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201024.259174:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdf125ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+8:5808:x1875064622416768:12345-0@lo:501: 00000100:00100000:1.0:1788201024.259382:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdf125ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+9:5808:x1875064622416768:12345-0@lo:501: Request processed in 209us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201024.259389:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201024.259460:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622416768:0@lo:501: 00000100:00100000:2.0:1788201024.259500:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622416896:0@lo:503: 00000100:00100000:2.0:1788201024.259535:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201024.259561:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b3b69aff going to sleep for 11 seconds 00000100:00100000:0.0:1788201024.259573:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622416896 00000100:00100000:0.0:1788201024.259577:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622416896 00000100:00100000:0.0:1788201024.259604:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201024.259610:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006128dbf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+9:5808:x1875064622416896:12345-0@lo:503: 00000100:00100000:0.0:1788201024.259775:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006128dbf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+9:5808:x1875064622416896:12345-0@lo:503: Request processed in 165us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201024.259782:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201024.259802:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622416896:0@lo:503: 00000100:00100000:3.0:1788201024.260278:0:5850:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:5850:1875064622417024:0@lo:502: 00000100:00100000:3.0:1788201024.260393:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201024.260424:0:5850:0:(client.c:2702:ptlrpc_set_wait()) set 0000000092677c94 going to sleep for 11 seconds 00000100:00100000:1.0:1788201024.260561:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622417024 00000100:00100000:1.0:1788201024.260565:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622417024 00000100:00100000:1.0:1788201024.260589:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788201024.260595:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005dc0608f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+9:5850:x1875064622417024:12345-0@lo:502: 00000100:00100000:1.0:1788201024.261194:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005dc0608f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+9:5850:x1875064622417024:12345-0@lo:502: Request processed in 597us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201024.261202:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201024.261229:0:5850:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:5850:1875064622417024:0@lo:502: 00000020:01000000:3.0:1788201024.261253:0:5850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201024.261264:0:5850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201024.261266:0:5850:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788201024.261271:0:5850:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788201024.261274:0:5850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201024.261291:0:5850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005de3384e) 00000020:00000080:3.0:1788201024.261309:0:5850:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788201024.261315:0:5850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788201024.261466:0:5850:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788201024.261474:0:5850:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72011f792b786824 00000020:00000080:3.0:1788201024.262074:0:5850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788201024.262081:0:5850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201024.262085:0:5850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201024.262087:0:5850:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788201024.262090:0:5850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201024.262093:0:5850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201024.262095:0:5850:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788201024.262098:0:5850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201024.262106:0:5850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000dd742863) 00000020:00000080:3.0:1788201024.262118:0:5850:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788201024.262122:0:5850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788201024.262123:0:5850:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788201024.262126:0:5850:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788201024.262160:0:5850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788201024.262217:0:5850:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002f4aac69 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788201024.262236:0:5850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d3093c07) 00000020:00000080:3.0:1788201024.262244:0:5850:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788201024.262306:0:5850:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788201024.262312:0:5850:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72011f792b786839 00000020:00000080:3.0:1788201024.262509:0:5850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788201024.262516:0:5850:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788201024.262526:0:5850:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x72011f792b786840 00080000:01000000:3.0:1788201024.262531:0:5850:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788201024.262535:0:5850:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72011f792b786847 00080000:10000000:3.0:1788201024.263057:0:5850:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788201024.263304:0:5850:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788201024.268825:0:5850:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788201024.354448:0:5850:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788201024.355009:0:5850:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788201024.358714:0:5850:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788201024.359050:0:5850:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788201024.394373:0:5850:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000013010b7e) 00000020:00000080:0.0:1788201024.394396:0:5850:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788201024.394490:0:5850:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788201024.394497:0:5850:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72011f792b786855 00000020:00000080:3.0:1788201024.401653:0:5850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788201024.403010:0:5850:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201024.434759:0:5850:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201024.457244:0:5850:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201024.479641:0:5850:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201024.503022:0:5850:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201024.532264:0:5850:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788201024.564699:0:5850:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x72011f792b78685c 00000020:00000080:2.0:1788201024.565430:0:5850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788201024.565441:0:5850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201024.565447:0:5850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201024.565455:0:5850:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788201024.565459:0:5850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201024.565464:0:5850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201024.565466:0:5850:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788201024.565469:0:5850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788201024.565505:0:5850:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788201024.565517:0:5850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201024.565520:0:5850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201024.565522:0:5850:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788201024.565524:0:5850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201024.565526:0:5850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201024.565528:0:5850:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788201024.565531:0:5850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788201024.565533:0:5850:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788201024.565571:0:5850:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:5850:1875064622417152:0@lo:502: 00000100:00100000:2.0:1788201024.565641:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201024.566621:0:5850:0:(client.c:2702:ptlrpc_set_wait()) set 000000003f70ad31 going to sleep for 11 seconds 00000100:00100000:3.0:1788201024.566895:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622417152 00000100:00100000:3.0:1788201024.566902:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622417152 00000100:00100000:3.0:1788201024.566946:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201024.566954:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9c6b992 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+9:5850:x1875064622417152:12345-0@lo:502: 00000100:00100000:3.0:1788201024.567638:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9c6b992 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+9:5850:x1875064622417152:12345-0@lo:502: Request processed in 683us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201024.567646:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201024.567743:0:5850:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:5850:1875064622417152:0@lo:502: 00000020:01000000:2.0:1788201024.567774:0:5850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201024.567781:0:5850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201024.567783:0:5850:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788201024.567787:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788201024.567940:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788201024.567955:0:5808:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788201024.567982:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 000000008ccd5161/0x72011f792b78680f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786816 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.567992:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 000000008ccd5161/0x72011f792b78680f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786816 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201024.567999:0:5808:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b0007c1d000 from 1 10000000:01000000:3.0:1788201024.568002:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201024.568032:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 00000000530fb119/0x72011f792b786863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.568039:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 00000000530fb119/0x72011f792b786863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.568060:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 00000000530fb119/0x72011f792b786863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201024.568076:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622417280:0@lo:101: 00000100:00100000:3.0:1788201024.568249:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201024.568311:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 0000000065ad3ae7 going to sleep for 11 seconds 00000100:00100000:2.0:1788201024.569488:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622417280 00000100:00100000:2.0:1788201024.569500:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622417280 00000100:00100000:2.0:1788201024.569546:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201024.569554:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083aa2834 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+9:5808:x1875064622417280:12345-0@lo:101: 00010000:00010000:2.0:1788201024.569569:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201024.569584:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000022b63710/0x72011f792b78686a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786863 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.569607:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000022b63710/0x72011f792b78686a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786863 expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.569626:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000022b63710/0x72011f792b78686a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786863 expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.569635:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000022b63710, rc 0) 00000100:00100000:2.0:1788201024.569680:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083aa2834 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+10:5808:x1875064622417280:12345-0@lo:101: Request processed in 127us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201024.569686:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201024.569775:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622417280:0@lo:101: 00010000:00010000:3.0:1788201024.569790:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 00000000530fb119/0x72011f792b786863 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b78686a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.569798:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 00000000530fb119/0x72011f792b786863 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b78686a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201024.570508:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622417408:0@lo:256: 00000100:00100000:3.0:1788201024.570554:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201024.570585:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 0000000065ad3ae7 going to sleep for 11 seconds 00000100:00100000:3.0:1788201024.570608:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622417408 00000100:00100000:3.0:1788201024.570613:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622417408 00000100:00100000:3.0:1788201024.570634:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788201024.570640:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a480e555 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+10:5808:x1875064622417408:12345-0@lo:256: 20000000:01000000:3.0:1788201024.570654:0:5821:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788201024.570659:0:5821:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788201024.570721:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a480e555 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+10:5808:x1875064622417408:12345-0@lo:256: Request processed in 81us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201024.570728:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788201024.570758:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622417408:0@lo:256: 10000000:01000000:3.0:1788201024.571789:0:5808:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788201024.571845:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 00000000530fb119/0x72011f792b786863 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b78686a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.571858:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 00000000530fb119/0x72011f792b786863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b78686a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201024.571866:0:5808:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b0007c1d000 from 1 10000000:01000000:3.0:1788201024.571869:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201024.571896:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 000000005045d51c/0x72011f792b786871 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.571903:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 000000005045d51c/0x72011f792b786871 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.571912:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 000000005045d51c/0x72011f792b786871 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201024.571927:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622417536:0@lo:101: 00000100:00100000:3.0:1788201024.571980:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201024.572008:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 0000000065ad3ae7 going to sleep for 11 seconds 00000100:00100000:0.0:1788201024.573033:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622417536 00000100:00100000:0.0:1788201024.573042:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622417536 00000100:00100000:0.0:1788201024.573081:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201024.573088:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009194c8b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+10:5808:x1875064622417536:12345-0@lo:101: 00010000:00010000:0.0:1788201024.573111:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201024.573124:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef30d95c/0x72011f792b786878 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786871 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201024.573179:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef30d95c/0x72011f792b786878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786871 expref: 11 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201024.573188:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef30d95c/0x72011f792b786878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786871 expref: 11 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201024.573196:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef30d95c, rc 0) 00000100:00100000:0.0:1788201024.573239:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009194c8b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+11:5808:x1875064622417536:12345-0@lo:101: Request processed in 152us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201024.573247:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201024.573524:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622417536:0@lo:101: 00010000:00010000:3.0:1788201024.573538:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 000000005045d51c/0x72011f792b786871 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786878 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.573547:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 000000005045d51c/0x72011f792b786871 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786878 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201024.573600:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622417664:0@lo:501: 00000100:00100000:3.0:1788201024.573639:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201024.573675:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 0000000065ad3ae7 going to sleep for 11 seconds 00000100:00100000:0.0:1788201024.573723:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622417664 00000100:00100000:0.0:1788201024.573727:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622417664 00000100:00100000:0.0:1788201024.573755:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201024.573761:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000570035db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+11:5808:x1875064622417664:12345-0@lo:501: 00000100:00100000:0.0:1788201024.574295:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000570035db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+11:5808:x1875064622417664:12345-0@lo:501: Request processed in 533us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201024.574304:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788201024.574436:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622417664:0@lo:501: 00000100:00100000:3.0:1788201024.574464:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622417792:0@lo:503: 00000100:00100000:3.0:1788201024.574502:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201024.574524:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 0000000065ad3ae7 going to sleep for 11 seconds 00000100:00100000:3.0:1788201024.574538:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622417792 00000100:00100000:3.0:1788201024.574542:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622417792 00000100:00100000:3.0:1788201024.574566:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788201024.574572:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097a60ff0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+11:5808:x1875064622417792:12345-0@lo:503: 00000040:00080000:3.0:1788201024.574606:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201024.574640:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097a60ff0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+11:5808:x1875064622417792:12345-0@lo:503: Request processed in 68us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201024.574646:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788201024.574682:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622417792:0@lo:503: 00000040:00080000:2.0:1788201024.575866:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788201024.577348:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788201024.577375:0:5808:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201024.577428:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 000000005045d51c/0x72011f792b786871 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786878 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.577441:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 000000005045d51c/0x72011f792b786871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786878 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201024.577482:0:5808:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788201024.577485:0:5808:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b0007c1d000 10000000:01000000:3.0:1788201024.577487:0:5808:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b0007c1d000 10000000:01000000:3.0:1788201024.577492:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201024.577506:0:5808:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b0007c1d000 from 1 10000000:01000000:3.0:1788201024.577508:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201024.577539:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 0000000097f86c76/0x72011f792b78687f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.577546:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 0000000097f86c76/0x72011f792b78687f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.577555:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 0000000097f86c76/0x72011f792b78687f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201024.577574:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622417920:0@lo:101: 00000100:00100000:3.0:1788201024.577631:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201024.577674:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cbbfa125 going to sleep for 11 seconds 00000100:00100000:0.0:1788201024.577795:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622417920 00000100:00100000:0.0:1788201024.577802:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622417920 00000100:00100000:0.0:1788201024.577843:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201024.577851:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ad8f6a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+11:5808:x1875064622417920:12345-0@lo:101: 00010000:00010000:0.0:1788201024.577862:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201024.577873:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b0f93dba/0x72011f792b786886 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b78687f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201024.577892:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b0f93dba/0x72011f792b786886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b78687f expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201024.577911:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b0f93dba/0x72011f792b786886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b78687f expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201024.577918:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b0f93dba, rc 0) 00000100:00100000:0.0:1788201024.577951:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ad8f6a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+12:5808:x1875064622417920:12345-0@lo:101: Request processed in 101us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201024.577967:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788201024.578049:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622417920:0@lo:101: 00010000:00010000:3.0:1788201024.578062:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 0000000097f86c76/0x72011f792b78687f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786886 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.578070:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 0000000097f86c76/0x72011f792b78687f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786886 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201024.578121:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622418048:0@lo:501: 00000100:00100000:3.0:1788201024.578269:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201024.578289:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cbbfa125 going to sleep for 11 seconds 00000100:00100000:0.0:1788201024.578340:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622418048 00000100:00100000:0.0:1788201024.578344:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622418048 00000100:00100000:0.0:1788201024.578371:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201024.578377:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b41b15d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+12:5808:x1875064622418048:12345-0@lo:501: 00000100:00100000:0.0:1788201024.578623:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b41b15d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+12:5808:x1875064622418048:12345-0@lo:501: Request processed in 246us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201024.578630:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201024.578771:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622418048:0@lo:501: 00000100:00100000:3.0:1788201024.578796:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622418176:0@lo:503: 00000100:00100000:3.0:1788201024.578836:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201024.578866:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cbbfa125 going to sleep for 11 seconds 00000100:00100000:0.0:1788201024.578917:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622418176 00000100:00100000:0.0:1788201024.578921:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622418176 00000100:00100000:0.0:1788201024.578950:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201024.578964:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf9aa001 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+12:5808:x1875064622418176:12345-0@lo:503: 00000100:00100000:0.0:1788201024.583389:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf9aa001 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+12:5808:x1875064622418176:12345-0@lo:503: Request processed in 4425us (4544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201024.583404:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201024.583574:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622418176:0@lo:503: 00000100:00100000:0.0:1788201024.584030:0:5856:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e5daa0ed pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:5856:1875064622418304:0@lo:502: 00000100:00100000:0.0:1788201024.584081:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201024.584225:0:5856:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ed60657b going to sleep for 11 seconds 00000100:00100000:3.0:1788201024.584315:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622418304 00000100:00100000:3.0:1788201024.584381:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622418304 00000100:00100000:3.0:1788201024.584455:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201024.584462:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e6d8dfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+12:5856:x1875064622418304:12345-0@lo:502: 00000100:00100000:3.0:1788201024.584734:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e6d8dfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+12:5856:x1875064622418304:12345-0@lo:502: Request processed in 272us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201024.584742:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201024.584813:0:5856:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e5daa0ed pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:5856:1875064622418304:0@lo:502: 00000020:01000004:1.0:1788201024.584867:0:5856:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788201024.584886:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000065b24848) 00000020:00000080:1.0:1788201024.584904:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788201024.585084:0:5856:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002f4aac69 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788201024.585087:0:5856:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002f4aac69 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788201024.585089:0:5856:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002f4aac69 4 00010000:00080000:1.0:1788201024.585127:0:5856:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009e8092a7@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.114@tcp at head 00010000:00010000:1.0:1788201024.586689:0:5856:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788201024.586778:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788201024.586807:0:5856:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201024.586823:0:5856:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x72011f792b786894 00000100:00080000:1.0:1788201024.586833:0:5856:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201024.586838:0:5856:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009e8092a7 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788201024.586877:0:5856:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000026e6777 x1875064622418432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201024.586926:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000026e6777 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875064622418432:0@lo:38: 00000100:00100000:1.0:1788201024.586998:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201024.587048:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622418432 00000100:00100000:1.0:1788201024.587053:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622418432 00000100:00100000:1.0:1788201024.587079:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201024.587084:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065891564 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1875064622418432:12345-0@lo:38: 00000100:00100000:1.0:1788201024.587131:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065891564 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1875064622418432:12345-0@lo:38: Request processed in 46us (133us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788201024.587158:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201024.587190:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201024.587197:0:3291:0:(import.c:65:import_set_state_nolock()) 000000009e8092a7 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201024.587211:0:3291:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788201024.587214:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000026e6777 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875064622418432:0@lo:38: 00000100:00080000:1.0:1788201024.587241:0:5856:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788201024.589540:0:5856:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000026e6777 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:5856:1875064622418560:0@lo:502: 00000100:00100000:1.0:1788201024.589611:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201024.589935:0:5856:0:(client.c:2702:ptlrpc_set_wait()) set 0000000026ed3c8b going to sleep for 11 seconds 00000100:00100000:0.0:1788201024.592483:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622418560 00000100:00100000:0.0:1788201024.592499:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622418560 00000100:00100000:0.0:1788201024.592635:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201024.592644:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a124cd58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+12:5856:x1875064622418560:12345-0@lo:502: 00000100:00100000:0.0:1788201024.593546:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a124cd58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+12:5856:x1875064622418560:12345-0@lo:502: Request processed in 901us (3932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201024.593556:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788201024.593859:0:5856:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000026e6777 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:5856:1875064622418560:0@lo:502: 00000040:00080000:1.0:1788201024.593893:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788201024.594028:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788201024.594055:0:5808:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201024.594082:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 0000000097f86c76/0x72011f792b78687f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786886 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.594091:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 0000000097f86c76/0x72011f792b78687f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786886 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788201024.595262:0:5808:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788201024.595266:0:5808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201024.595267:0:5808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201024.595268:0:5808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201024.595269:0:5808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201024.595272:0:5808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201024.595273:0:5808:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201024.595274:0:5808:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201024.595276:0:5808:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788201024.595277:0:5808:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788201024.595278:0:5808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201024.595280:0:5808:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201024.595283:0:5808:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788201024.595286:0:5808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201024.595287:0:5808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201024.595288:0:5808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201024.595293:0:5808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201024.595294:0:5808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201024.595295:0:5808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201024.595296:0:5808:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201024.595297:0:5808:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201024.595298:0:5808:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788201024.595299:0:5808:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788201024.595299:0:5808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201024.595300:0:5808:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201024.595536:0:5808:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788201024.595553:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622418688:0@lo:253: 00000100:00100000:2.0:1788201024.595607:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201024.595687:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 000000001ebaf665 going to sleep for 11 seconds 00000100:00100000:0.0:1788201024.603249:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622418688 00000100:00100000:0.0:1788201024.603265:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622418688 00000100:00100000:0.0:1788201024.603639:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788201024.603649:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be1c9bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+12:5808:x1875064622418688:12345-0@lo:253: 20000000:01000000:0.0:1788201024.603681:0:5821:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788201024.603695:0:5821:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788201024.634876:0:5821:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201024.634893:0:5821:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788201024.634952:0:5843:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788201024.634965:0:5843:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788201024.634983:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000657c9f05/0x72011f792b78689b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.635001:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000022b63710/0x72011f792b78686a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786863 expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.635008:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000657c9f05/0x72011f792b78689b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.635043:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000022b63710/0x72011f792b78686a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b786863 expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201024.635057:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000022b63710/0x72011f792b78686a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b786863 expref: 12 pid: 5819 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201024.635069:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5843:1875064622418816:0@lo:104: 00000100:00100000:3.0:1788201024.635152:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201024.635199:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e7b00a08 going to sleep for 11 seconds 00000100:00100000:2.0:1788201024.635346:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622418816 00000100:00100000:2.0:1788201024.635353:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622418816 00000100:00100000:2.0:1788201024.635397:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201024.635405:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063b76224 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+3:5843:x1875064622418816:12345-0@lo:104: 00010000:00010000:2.0:1788201024.635416:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: 00000000530fb119/0x72011f792b786863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b78686a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.635464:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201024.635469:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063b76224 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+3:5843:x1875064622418816:12345-0@lo:104: Request processed in 66us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201024.635476:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788201024.635494:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201024.635499:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: 00000000530fb119/0x72011f792b786863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b78686a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.635506:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000530fb119 already unused, calling callback (000000001b845836) 10000000:00010000:2.0:1788201024.635508:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: 00000000530fb119/0x72011f792b786863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b78686a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.635529:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: 00000000530fb119/0x72011f792b786863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b78686a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201024.635536:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: 00000000530fb119/0x72011f792b786863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b78686a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201024.635540:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201024.635565:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: 00000000530fb119/0x72011f792b786863 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b78686a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.635572:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201024.635586:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: 00000000530fb119/0x72011f792b786863 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b78686a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.635592:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: 00000000530fb119/0x72011f792b786863 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b78686a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.635608:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201024.635609:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201024.635611:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201024.635680:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201024.635689:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a306adda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622418944:0@lo:103: 00000100:00100000:2.0:1788201024.635715:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201024.635752:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b276dd6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5843:1875064622418816:0@lo:104: 00010000:00010000:2.0:1788201024.635767:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000657c9f05/0x72011f792b78689b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201024.636281:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622418944 00000100:00100000:1.0:1788201024.636287:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622418944 00010000:00010000:1.0:1788201024.636311:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000022b63710/0x72011f792b78686a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786863 expref: 13 pid: 5819 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201024.636342:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201024.636349:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ea5a634 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16f590af-689d-4459-b486-809c9db65822+13:3292:x1875064622418944:12345-0@lo:103: 00010000:00010000:1.0:1788201024.636360:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201024.636364:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000022b63710/0x72011f792b78686a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786863 expref: 13 pid: 5819 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201024.636373:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000022b63710/0x72011f792b78686a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b786863 expref: 13 pid: 5819 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201024.636384:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000022b63710/0x72011f792b78686a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b786863 expref: 13 pid: 5819 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201024.636397:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000657c9f05/0x72011f792b78689b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201024.636404:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000657c9f05/0x72011f792b78689b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201024.636416:0:5812:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001460606s 00010000:00010000:1.0:1788201024.636420:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000657c9f05/0x72011f792b78689b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201024.636427:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000657c9f05/0x72011f792b78689b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201024.636433:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000657c9f05/0x72011f792b78689b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201024.636438:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000657c9f05/0x72011f792b78689b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201024.636449:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000657c9f05 already unused, calling callback (000000008e60a636) 00010000:00010000:1.0:1788201024.636452:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000657c9f05/0x72011f792b78689b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201024.636458:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000657c9f05/0x72011f792b78689b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201024.636477:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000657c9f05/0x72011f792b78689b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201024.636486:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201024.636527:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ea5a634 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16f590af-689d-4459-b486-809c9db65822+12:3292:x1875064622418944:12345-0@lo:103: Request processed in 179us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201024.636534:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201024.636569:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a306adda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622418944:0@lo:103: 00010000:00010000:2.0:1788201024.636664:0:5843:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000657c9f05/0x72011f792b78689b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.636681:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000657c9f05/0x72011f792b78689b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201024.636688:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000657c9f05/0x72011f792b78689b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201024.645420:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be1c9bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+11:5808:x1875064622418688:12345-0@lo:253: Request processed in 41766us (49806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201024.645434:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201024.645515:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:5808:1875064622418688:0@lo:253: 10000000:01000000:2.0:1788201024.645529:0:5808:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788201024.645532:0:5808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201024.645534:0:5808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201024.645535:0:5808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201024.645536:0:5808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201024.645538:0:5808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201024.645539:0:5808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201024.645540:0:5808:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201024.645541:0:5808:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201024.645542:0:5808:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788201024.645544:0:5808:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788201024.645545:0:5808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201024.645546:0:5808:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788201024.645557:0:5808:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788201024.648768:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201024.650029:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788201024.650538:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201024.650728:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788201024.650924:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201024.651397:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788201024.651989:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201024.652266:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788201024.652524:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201024.652696:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788201024.652916:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201024.653268:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1788201024.741598:0:5808:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788201024.805814:0:5808:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788201024.805904:0:5861:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788201024.805908:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788201024.806481:0:5862:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788201024.815422:0:5808:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788201024.815767:0:5808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788201024.816217:0:5808:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788201024.816543:0:5808:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788201024.816702:0:5808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201024.817658:0:5808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788201024.819618:0:5808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788201024.819681:0:5808:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788201024.819969:0:5808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788201024.821673:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788201024.832252:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788201024.832525:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788201024.832679:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788201024.832830:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788201024.834997:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788201024.835281:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788201024.835422:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788201024.835721:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788201024.835982:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788201024.836129:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788201024.838907:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788201024.839117:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788201024.839290:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788201024.839444:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788201024.839643:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788201024.839807:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788201024.840106:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788201024.840297:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788201024.840440:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788201024.840613:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788201024.840764:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788201024.840928:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788201024.841083:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788201024.841262:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788201024.841399:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788201024.842923:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788201024.843102:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788201024.843313:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788201024.843846:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788201024.844515:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788201024.844973:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788201024.845968:0:5808:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788201024.846430:0:5808:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788201024.861875:0:5862:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1788201024.923094:0:5808:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788201024.923175:0:5808:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb3aec1c7b988 00100000:10000000:1.0:1788201024.923185:0:5808:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788201024.923924:0:5808:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788201024.923938:0:5808:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.114@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788201024.923950:0:5808:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788201024.923994:0:5808:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1788201024.966786:0:5862:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788201024.966868:0:5862:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788201024.966885:0:5862:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788201024.977208:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201025.995453:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201027.019434:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201028.044975:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201028.809617:0:6104:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788201029.067754:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201029.903377:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201029.903385:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201029.903388:0:36:0:(import.c:65:import_set_state_nolock()) 000000009e8092a7 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201029.903401:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009e8092a7 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788201029.903424:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002ef89bc7 x1875064622419200/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201029.903466:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002ef89bc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875064622419200:0@lo:38: 00000100:00100000:0.0:1788201029.903472:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cb6e568c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622419072:0@lo:400: 00000100:00100000:3.0:1788201029.904598:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201029.907555:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201029.909566:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622419072 00000100:00100000:3.0:1788201029.909579:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622419072 00000100:00100000:3.0:1788201029.909644:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201029.909652:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001b12f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+11:3294:x1875064622419072:12345-0@lo:400: 00000100:00100000:3.0:1788201029.909837:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001b12f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+11:3294:x1875064622419072:12345-0@lo:400: Request processed in 185us (2288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201029.909846:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201029.909909:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cb6e568c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622419072:0@lo:400: 00000100:00100000:2.0:1788201029.910605:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622419200 00000100:00100000:2.0:1788201029.910612:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622419200 00000100:00100000:2.0:1788201029.912165:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201029.912175:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d643dc0c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3291:x1875064622419200:12345-0@lo:38: 00010000:00080000:2.0:1788201029.912201:0:5829:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 109 last 0 00000020:00000080:2.0:1788201029.912233:0:5829:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x72011f792b7868a2 00000004:00100000:2.0:1788201029.912267:0:5829:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201029.912500:0:5829:0:(import.c:65:import_set_state_nolock()) 000000005e93b4ec : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201029.912576:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d643dc0c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875064622419200:12345-0@lo:38: Request processed in 402us (7982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201029.912585:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788201029.920816:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002ef89bc7 x1875064622419200/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201029.920838:0:3291:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788201029.920845:0:3291:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788201029.920850:0:3291:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788201029.920853:0:3291:0:(import.c:65:import_set_state_nolock()) 000000009e8092a7 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201029.920858:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002ef89bc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875064622419200:0@lo:38: 00010000:00010000:0.0:1788201030.091827:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788201030.923305:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788201030.923313:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b0007c1d000 from 3 10000000:01000000:0.0:1788201030.923318:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201030.923375:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 000000000b22a2aa/0x72011f792b7868a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201030.923407:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 000000000b22a2aa/0x72011f792b7868a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201030.923418:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 000000000b22a2aa/0x72011f792b7868a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201030.923442:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c59b0447 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622419328:0@lo:101: 00000100:00100000:0.0:1788201030.923512:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201030.923573:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 000000000e76aa34 going to sleep for 11 seconds 00000100:00100000:1.0:1788201030.924007:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622419328 00000100:00100000:1.0:1788201030.924016:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622419328 00000100:00100000:1.0:1788201030.924063:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201030.924071:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1490494 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+11:5825:x1875064622419328:12345-0@lo:101: 00010000:00010000:1.0:1788201030.924086:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201030.924099:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000795d5738/0x72011f792b7868b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b7868a9 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201030.924121:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000795d5738/0x72011f792b7868b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b7868a9 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201030.924154:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000795d5738/0x72011f792b7868b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b7868a9 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201030.924165:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000795d5738, rc 0) 00000100:00100000:1.0:1788201030.924219:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1490494 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+12:5825:x1875064622419328:12345-0@lo:101: Request processed in 148us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201030.924226:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788201030.924567:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c59b0447 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622419328:0@lo:101: 00010000:00010000:0.0:1788201030.924582:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 000000000b22a2aa/0x72011f792b7868a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7868b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201030.924591:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 000000000b22a2aa/0x72011f792b7868a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b7868b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201030.924649:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c59b0447 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622419456:0@lo:256: 00000100:00100000:0.0:1788201030.924683:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201030.924716:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 000000000e76aa34 going to sleep for 11 seconds 00000100:00100000:3.0:1788201030.924788:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622419456 00000100:00100000:3.0:1788201030.924798:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622419456 00000100:00100000:3.0:1788201030.924832:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201030.924839:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005fb6d281 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+12:5825:x1875064622419456:12345-0@lo:256: 20000000:01000000:3.0:1788201030.924853:0:5819:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788201030.924878:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788201030.924881:0:5819:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788201030.924970:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005fb6d281 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+12:5825:x1875064622419456:12345-0@lo:256: Request processed in 131us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201030.924977:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788201030.925079:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c59b0447 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622419456:0@lo:256: 10000000:01000000:0.0:1788201030.925120:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201030.925126:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: 000000000b22a2aa/0x72011f792b7868a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7868b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201030.925153:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: 000000000b22a2aa/0x72011f792b7868a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7868b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.119445:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201032.144300:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201033.165567:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201033.222728:0:6306:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef4b7d210 20000000:00000080:1.0:1788201033.222744:0:6306:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b0027e12800 uarg=0000000000000000 20000000:01000000:1.0:1788201033.222775:0:6306:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788201033.222781:0:6306:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788201033.222791:0:6306:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788201033.228001:0:6306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788201033.228020:0:6306:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788201033.242882:0:6306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201033.243209:0:6306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788201033.243264:0:6306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788201033.243326:0:6306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788201033.243344:0:6306:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788201033.243361:0:6306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000037c82caf/0x72011f792b7868b7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201033.243378:0:6306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ef30d95c/0x72011f792b786878 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786871 expref: 11 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201033.243386:0:6306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000037c82caf/0x72011f792b7868b7 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201033.243421:0:6306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ef30d95c/0x72011f792b786878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b786871 expref: 11 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201033.243434:0:6306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ef30d95c/0x72011f792b786878 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b786871 expref: 11 pid: 5821 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201033.243448:0:6306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6306:1875064622419584:0@lo:104: 00000100:00100000:2.0:1788201033.243579:0:6306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201033.243736:0:6306:0:(client.c:2702:ptlrpc_set_wait()) set 000000009d5f4a24 going to sleep for 11 seconds 00000100:00100000:3.0:1788201033.243876:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622419584 00000100:00100000:3.0:1788201033.243885:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622419584 00000100:00100000:3.0:1788201033.243943:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201033.243951:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c31db11e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16f590af-689d-4459-b486-809c9db65822+3:6306:x1875064622419584:12345-0@lo:104: 00010000:00010000:3.0:1788201033.243964:0:5811:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: 000000005045d51c/0x72011f792b786871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786878 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201033.244038:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201033.244043:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c31db11e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16f590af-689d-4459-b486-809c9db65822+3:6306:x1875064622419584:12345-0@lo:104: Request processed in 94us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201033.244050:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788201033.244107:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201033.244113:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: 000000005045d51c/0x72011f792b786871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786878 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201033.244121:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005045d51c already unused, calling callback (000000001b845836) 10000000:00010000:1.0:1788201033.244124:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: 000000005045d51c/0x72011f792b786871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b786878 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201033.244153:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: 000000005045d51c/0x72011f792b786871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b786878 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201033.244160:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: 000000005045d51c/0x72011f792b786871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b786878 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201033.244165:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788201033.244192:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: 000000005045d51c/0x72011f792b786871 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786878 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201033.244199:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201033.244216:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: 000000005045d51c/0x72011f792b786871 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786878 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201033.244222:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: 000000005045d51c/0x72011f792b786871 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786878 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201033.244235:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201033.244237:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201033.244238:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201033.244256:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000026e6777 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622419712:0@lo:103: 00000100:00100000:1.0:1788201033.244312:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201033.244397:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622419712 00000100:00100000:2.0:1788201033.244402:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622419712 00010000:00010000:2.0:1788201033.244421:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ef30d95c/0x72011f792b786878 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786871 expref: 12 pid: 5821 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201033.244454:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201033.244460:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008eba0148 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16f590af-689d-4459-b486-809c9db65822+12:3295:x1875064622419712:12345-0@lo:103: 00010000:00010000:2.0:1788201033.244470:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201033.244475:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ef30d95c/0x72011f792b786878 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786871 expref: 12 pid: 5821 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201033.244495:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ef30d95c/0x72011f792b786878 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b786871 expref: 12 pid: 5821 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201033.244519:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000037c82caf/0x72011f792b7868b7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201033.244526:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000037c82caf/0x72011f792b7868b7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201033.244539:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000037c82caf/0x72011f792b7868b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201033.244545:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000037c82caf/0x72011f792b7868b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201033.244551:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000037c82caf/0x72011f792b7868b7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201033.244557:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000037c82caf/0x72011f792b7868b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201033.244563:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000037c82caf already unused, calling callback (000000008e60a636) 00010000:00010000:2.0:1788201033.244566:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000037c82caf/0x72011f792b7868b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201033.244572:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000037c82caf/0x72011f792b7868b7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201033.244580:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000037c82caf/0x72011f792b7868b7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201033.244616:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201033.244653:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008eba0148 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16f590af-689d-4459-b486-809c9db65822+12:3295:x1875064622419712:12345-0@lo:103: Request processed in 192us (340us total) trans 0 rc 0/0 00010000:00010000:0.0:1788201033.244653:0:6306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ef30d95c/0x72011f792b786878 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b786871 expref: 12 pid: 5821 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201033.244668:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201033.244678:0:6306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009cd0fd7a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6306:1875064622419584:0@lo:104: 00010000:00010000:0.0:1788201033.244699:0:6306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000037c82caf/0x72011f792b7868b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201033.244708:0:6306:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000037c82caf/0x72011f792b7868b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201033.244713:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000026e6777 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622419712:0@lo:103: 00010000:00010000:0.0:1788201033.244716:0:6306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000037c82caf/0x72011f792b7868b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201033.244724:0:6306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000037c82caf/0x72011f792b7868b7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201034.188747:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201035.020220:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001e4d15a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622419840:0@lo:400: 00000100:00100000:2.0:1788201035.020350:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201035.020409:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201035.020414:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000017ba3f24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622419968:0@lo:400: 00000100:00100000:2.0:1788201035.020487:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201035.020563:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622419840 00000100:00100000:1.0:1788201035.020571:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622419840 00000100:00100000:1.0:1788201035.020619:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201035.020628:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024ad45e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+11:3292:x1875064622419840:12345-0@lo:400: 00000100:00100000:1.0:1788201035.020679:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024ad45e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+11:3292:x1875064622419840:12345-0@lo:400: Request processed in 52us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201035.020686:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201035.020716:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622419968 00000100:00100000:1.0:1788201035.020720:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622419968 00000100:00100000:1.0:1788201035.020748:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201035.020754:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002842520e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622419968:12345-0@lo:400: 00000100:00100000:1.0:1788201035.020785:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002842520e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622419968:12345-0@lo:400: Request processed in 32us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201035.020791:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788201035.020822:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000017ba3f24 x1875064622419968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201035.020836:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000017ba3f24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622419968:0@lo:400: 00000100:00100000:1.0:1788201035.020846:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001e4d15a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622419840:0@lo:400: 00010000:00010000:1.0:1788201035.212925:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201036.237246:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201037.259384:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788201038.091611:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201038.091619:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b0007c1d000 from 1 10000000:01000000:0.0:1788201038.091624:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201038.091666:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: 00000000795cb628/0x72011f792b7868be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.091678:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: 00000000795cb628/0x72011f792b7868be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.091688:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: 00000000795cb628/0x72011f792b7868be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201038.091711:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c59b0447 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622420096:0@lo:101: 00000100:00100000:0.0:1788201038.091783:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201038.091853:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d91f5b56 going to sleep for 11 seconds 00000100:00100000:1.0:1788201038.091967:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622420096 00000100:00100000:1.0:1788201038.091974:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622420096 00000100:00100000:1.0:1788201038.092030:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201038.092039:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047395252 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+11:5825:x1875064622420096:12345-0@lo:101: 00010000:00010000:1.0:1788201038.092062:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201038.092075:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000150c751a/0x72011f792b7868c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b7868be expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.092097:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000150c751a/0x72011f792b7868c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b7868be expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.092107:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000150c751a/0x72011f792b7868c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b7868be expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.092116:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000150c751a, rc 0) 00000100:00100000:1.0:1788201038.092196:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047395252 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+12:5825:x1875064622420096:12345-0@lo:101: Request processed in 158us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201038.092203:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201038.092238:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c59b0447 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622420096:0@lo:101: 00010000:00010000:2.0:1788201038.092256:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: 00000000795cb628/0x72011f792b7868be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7868c5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.092266:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: 00000000795cb628/0x72011f792b7868be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b7868c5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201038.092330:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000005352cd3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622420224:0@lo:501: 00000100:00100000:2.0:1788201038.092357:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201038.092398:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f86fba86 going to sleep for 11 seconds 00000100:00100000:0.0:1788201038.092419:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622420224 00000100:00100000:0.0:1788201038.092424:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622420224 00000100:00100000:0.0:1788201038.092456:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201038.092463:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce723b4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+12:5825:x1875064622420224:12345-0@lo:501: 00000100:00100000:0.0:1788201038.092795:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce723b4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+12:5825:x1875064622420224:12345-0@lo:501: Request processed in 331us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201038.092803:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201038.092910:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000005352cd3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622420224:0@lo:501: 00000100:00100000:2.0:1788201038.092939:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000005352cd3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622420352:0@lo:503: 00000100:00100000:2.0:1788201038.092975:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201038.093005:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f86fba86 going to sleep for 11 seconds 00000100:00100000:0.0:1788201038.093362:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622420352 00000100:00100000:0.0:1788201038.093368:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622420352 00000100:00100000:0.0:1788201038.093609:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201038.093618:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086b8221b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+12:5825:x1875064622420352:12345-0@lo:503: 00000100:00100000:0.0:1788201038.093967:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086b8221b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+12:5825:x1875064622420352:12345-0@lo:503: Request processed in 350us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201038.093976:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788201038.094448:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000005352cd3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622420352:0@lo:503: 00000100:00100000:2.0:1788201038.095052:0:6647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000005352cd3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:6647:1875064622420480:0@lo:502: 00000100:00100000:2.0:1788201038.095666:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201038.095706:0:6647:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f8d5d25e going to sleep for 11 seconds 00000100:00100000:3.0:1788201038.095842:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622420480 00000100:00100000:3.0:1788201038.095856:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622420480 00000100:00100000:3.0:1788201038.095964:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201038.095974:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009648bbb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+12:6647:x1875064622420480:12345-0@lo:502: 00000100:00100000:3.0:1788201038.096296:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009648bbb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+12:6647:x1875064622420480:12345-0@lo:502: Request processed in 323us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201038.096313:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201038.096375:0:6647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000005352cd3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:6647:1875064622420480:0@lo:502: 00000020:01000000:0.0:1788201038.096576:0:6647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201038.096585:0:6647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201038.096587:0:6647:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788201038.096594:0:6647:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b0007c1d000 00000020:00000080:0.0:1788201038.096596:0:6647:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788201038.096640:0:6647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:6647:1875064622420608:0@lo:502: 00000100:00100000:0.0:1788201038.096681:0:6647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201038.097353:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622420608 00000100:00100000:2.0:1788201038.097362:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622420608 00000100:00100000:2.0:1788201038.100490:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201038.100508:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+12:6647:x1875064622420608:12345-0@lo:502: 00000100:00100000:0.0:1788201038.101105:0:6647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005d30480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201038.101888:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+12:6647:x1875064622420608:12345-0@lo:502: Request processed in 1383us (5202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201038.101899:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201038.102039:0:6647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:6647:1875064622420608:0@lo:502: 00000020:01000000:0.0:1788201038.102090:0:6647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201038.102106:0:6647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201038.102124:0:6647:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788201038.102130:0:6647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788201038.102250:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788201038.102272:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201038.102459:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000030200/0x72011f792b7868be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7868c5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.102471:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0000030200/0x72011f792b7868be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7868c5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.285874:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788201038.641627:0:6672:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788201038.641631:0:6672:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788201038.641772:0:6672:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b0010346000 00000020:01000004:1.0:1788201038.641787:0:6672:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788201038.641797:0:6672:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788201038.641810:0:6672:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b0010a48000) 00000020:00000080:1.0:1788201038.641824:0:6672:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788201038.659093:0:6672:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788201038.659599:0:6672:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788201038.680775:0:6672:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788201038.689873:0:6672:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788201038.689977:0:6672:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788201038.690110:0:6672:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788201038.690165:0:6672:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788201038.690872:0:6672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788201038.690882:0:6672:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788201038.690956:0:6672:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72011f792b7868d3 00000020:01000004:3.0:1788201038.690965:0:6672:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788201038.690988:0:6672:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.114@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788201038.690991:0:6672:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788201038.690997:0:6672:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788201038.691063:0:6672:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788201038.691076:0:6672:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b004093b380) 00000020:00000080:3.0:1788201038.691087:0:6672:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788201038.693071:0:6672:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201038.693638:0:6672:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788201038.693644:0:6672:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788201038.695429:0:6672:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788201038.695439:0:6672:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788201038.703243:0:6672:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788201038.703521:0:6672:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788201038.706716:0:6672:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201038.707119:0:6672:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788201038.707127:0:6672:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788201038.707702:0:6672:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788201038.707708:0:6672:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788201038.733013:0:6672:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201038.733523:0:6672:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788201038.733531:0:6672:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788201038.738698:0:6672:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788201038.738712:0:6672:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788201038.741578:0:6672:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788201038.741602:0:6672:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788201038.752723:0:6672:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201038.752978:0:6672:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788201038.752985:0:6672:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788201038.758363:0:6672:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788201038.758378:0:6672:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788201038.801580:0:6672:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201038.801768:0:6672:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788201038.801775:0:6672:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788201038.803488:0:6672:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788201038.803499:0:6672:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788201038.803943:0:6672:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788201038.803964:0:6672:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788201038.803970:0:6672:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.114@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788201038.840409:0:6672:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788201038.840446:0:6672:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.114@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788201038.840450:0:6672:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788201038.840455:0:6672:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201038.840456:0:6672:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201038.840457:0:6672:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201038.840458:0:6672:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201038.840459:0:6672:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201038.840461:0:6672:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201038.840462:0:6672:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788201038.840463:0:6672:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788201038.840465:0:6672:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201038.840466:0:6672:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201038.840469:0:6672:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788201038.840472:0:6672:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201038.840473:0:6672:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201038.840474:0:6672:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201038.840475:0:6672:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201038.840476:0:6672:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201038.840477:0:6672:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201038.840478:0:6672:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201038.840479:0:6672:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788201038.840480:0:6672:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788201038.840481:0:6672:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201038.840482:0:6672:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201038.840507:0:6672:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788201038.840524:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005135c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622420736:0@lo:253: 00000100:00100000:2.0:1788201038.840597:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201038.840697:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005efa480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201038.840742:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622420736 00000100:00100000:0.0:1788201038.840750:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622420736 00000100:00100000:0.0:1788201038.840825:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201038.840834:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+12:6672:x1875064622420736:12345-0@lo:253: 20000000:01000000:0.0:1788201038.840882:0:5822:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788201038.840886:0:5822:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788201038.840891:0:5822:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788201038.840894:0:5822:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788201038.841913:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201038.842113:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788201038.842128:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788201038.842468:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788201038.842478:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788201038.842511:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788201038.842584:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788201038.844063:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788201038.844089:0:5822:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.114@tcp 20000000:01000000:0.0:1788201038.844092:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.114@tcp (null) (null) (null) 00000040:00080000:0.0:1788201038.844130:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788201038.844411:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788201038.844472:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788201038.844480:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.114@tcp (null) (null) 00000040:00080000:0.0:1788201038.844515:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788201038.844537:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788201038.844573:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788201038.844625:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788201038.845455:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788201038.845473:0:5822:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.114@tcp 20000000:01000000:0.0:1788201038.845475:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.114@tcp (null) (null) (null) 00000040:00080000:0.0:1788201038.845509:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788201038.845517:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788201038.845551:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788201038.845558:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.114@tcp (null) (null) 00000040:00080000:0.0:1788201038.845622:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788201038.845633:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788201038.845664:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788201038.845699:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788201038.845715:0:5822:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788201038.845718:0:5822:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788201038.845723:0:5822:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788201038.845725:0:5822:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788201038.845727:0:5822:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788201038.845738:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788201038.845740:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788201038.845770:0:5822:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788201038.845772:0:5822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788201038.846944:0:6688:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788201038.847017:0:6688:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788201038.847070:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788201038.847468:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788201038.847511:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788201038.847548:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788201038.847562:0:5822:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788201038.847565:0:5822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788201038.852351:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1788201038.852435:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1788201038.852494:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788201038.852808:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788201038.852853:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788201038.852932:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788201038.852948:0:5822:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788201038.852950:0:5822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788201038.853571:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788201038.853865:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788201038.853914:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788201038.853967:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1788201038.853984:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788201038.854002:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0000030e00/0x72011f792b7868e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.854018:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0000031c00/0x72011f792b7867fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b7867f3 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.854025:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0000031800/0x72011f792b786816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b78680f expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.854031:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0000030a00/0x72011f792b786886 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b78687f expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.854037:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0000030e00/0x72011f792b7868e1 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.854071:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0000030a00/0x72011f792b786886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b78687f expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.854084:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b0000030a00/0x72011f792b786886 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b78687f expref: 12 pid: 5819 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201038.854097:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5822:1875064622420864:0@lo:104: 00000100:00100000:0.0:1788201038.854187:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201038.854281:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0000031800/0x72011f792b786816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b78680f expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.854290:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b0000031800/0x72011f792b786816 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b78680f expref: 12 pid: 5822 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201038.854309:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5822:1875064622420992:0@lo:104: 00000100:00100000:0.0:1788201038.854332:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201038.854533:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0000031c00/0x72011f792b7867fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b7867f3 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.854540:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b0000031c00/0x72011f792b7867fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b7867f3 expref: 12 pid: 5821 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201038.854548:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5822:1875064622421120:0@lo:104: 00000100:00100000:0.0:1788201038.854567:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201038.855266:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622420864 00000100:00100000:3.0:1788201038.855274:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622420864 00000100:00100000:3.0:1788201038.855317:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622420992 00000100:00100000:3.0:1788201038.855320:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622420992 00000100:00100000:3.0:1788201038.855335:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201038.855344:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16f590af-689d-4459-b486-809c9db65822+4:5822:x1875064622420864:12345-0@lo:104: 00010000:00010000:3.0:1788201038.855357:0:5811:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b00126fdc00/0x72011f792b78687f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786886 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.855422:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201038.855585:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16f590af-689d-4459-b486-809c9db65822+4:5822:x1875064622420864:12345-0@lo:104: Request processed in 87us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201038.855594:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201038.855611:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201038.855619:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16f590af-689d-4459-b486-809c9db65822+3:5822:x1875064622420992:12345-0@lo:104: 00010000:00010000:3.0:1788201038.855627:0:5811:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b00029c7800/0x72011f792b78680f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786816 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.855667:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201038.855673:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16f590af-689d-4459-b486-809c9db65822+3:5822:x1875064622420992:12345-0@lo:104: Request processed in 56us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201038.855678:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788201038.855698:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201038.855711:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b00126fdc00/0x72011f792b78687f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786886 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.855827:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fdc00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1788201038.855833:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b00126fdc00/0x72011f792b78687f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b786886 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.855842:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b00126fdc00/0x72011f792b78687f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b786886 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201038.855849:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b00126fdc00/0x72011f792b78687f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b786886 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201038.855854:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201038.855898:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b00126fdc00/0x72011f792b78687f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786886 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.855905:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201038.855921:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b00126fdc00/0x72011f792b78687f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786886 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.856361:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b00126fdc00/0x72011f792b78687f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786886 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.856375:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201038.856378:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b00029c7800/0x72011f792b78680f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786816 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.856384:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7800 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1788201038.856387:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b00029c7800/0x72011f792b78680f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b786816 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.856405:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b00029c7800/0x72011f792b78680f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b786816 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201038.856412:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b00029c7800/0x72011f792b78680f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b786816 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201038.856417:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201038.856442:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b00029c7800/0x72011f792b78680f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786816 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.856448:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201038.856454:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b00029c7800/0x72011f792b78680f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786816 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.856460:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b00029c7800/0x72011f792b78680f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786816 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.856471:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201038.856473:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201038.856474:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201038.856500:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622421248:0@lo:103: 00010000:00010000:1.0:1788201038.856523:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201038.856550:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201038.856585:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201038.856591:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622421376:0@lo:103: 00000100:00100000:1.0:1788201038.856607:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622421248 00000100:00100000:1.0:1788201038.856613:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622421248 00000100:00100000:3.0:1788201038.856637:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201038.856643:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0000030a00/0x72011f792b786886 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b78687f expref: 13 pid: 5819 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201038.856683:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622421376 00000100:00100000:1.0:1788201038.856687:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622421376 00000100:00100000:3.0:1788201038.856688:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201038.856700:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040905f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+14:3294:x1875064622421248:12345-0@lo:103: 00010000:00010000:1.0:1788201038.856705:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0000031800/0x72011f792b786816 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b78680f expref: 14 pid: 5822 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.856712:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788201038.856720:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788201038.856727:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788201038.856749:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788201038.856756:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201038.856763:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040906680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16f590af-689d-4459-b486-809c9db65822+14:3294:x1875064622421376:12345-0@lo:103: 00010000:00010000:1.0:1788201038.856772:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201038.856777:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0000031800/0x72011f792b786816 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b78680f expref: 14 pid: 5822 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.856787:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0000031800/0x72011f792b786816 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b78680f expref: 14 pid: 5822 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.856801:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201038.856835:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040906680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16f590af-689d-4459-b486-809c9db65822+14:3294:x1875064622421376:12345-0@lo:103: Request processed in 72us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201038.856842:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788201038.858306:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0000030a00/0x72011f792b786886 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b78687f expref: 13 pid: 5819 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.858321:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0000030a00/0x72011f792b786886 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b78687f expref: 13 pid: 5819 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.858337:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201038.858387:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040905f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+13:3294:x1875064622421248:12345-0@lo:103: Request processed in 1689us (1836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201038.858395:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201038.858446:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622421376:0@lo:103: 00000100:00100000:3.0:1788201038.858462:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622421248:0@lo:103: 00000100:00100000:2.0:1788201038.859214:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622421120 00000100:00100000:2.0:1788201038.859223:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622421120 00000100:00100000:2.0:1788201038.859263:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201038.859271:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+3:5822:x1875064622421120:12345-0@lo:104: 00010000:00010000:2.0:1788201038.859286:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b00029c6400/0x72011f792b7867f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b7867fa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201038.860226:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010d5ccc0 going to sleep for 11 seconds 00010000:00010000:0.0:1788201038.860256:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0000030a00/0x72011f792b786886 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b78687f expref: 12 pid: 5819 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201038.860272:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5822:1875064622420864:0@lo:104: 00010000:00010000:0.0:1788201038.860285:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0000031800/0x72011f792b786816 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b78680f expref: 11 pid: 5822 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201038.860297:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5822:1875064622420992:0@lo:104: 00000100:00100000:0.0:1788201038.860309:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5822:1875064622421120:0@lo:104: 00010000:00010000:0.0:1788201038.860331:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0000030e00/0x72011f792b7868e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.860472:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201038.860479:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:0.0:1788201038.860480:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b00029c6400/0x72011f792b7867f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b7867fa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201038.860491:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+3:5822:x1875064622421120:12345-0@lo:104: Request processed in 1219us (5920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201038.860504:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788201038.860507:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6400 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1788201038.860513:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b00029c6400/0x72011f792b7867f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b7867fa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.860523:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b00029c6400/0x72011f792b7867f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b7867fa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201038.860530:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b00029c6400/0x72011f792b7867f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b7867fa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201038.860537:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201038.860574:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b00029c6400/0x72011f792b7867f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b7867fa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.860581:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201038.860635:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622421504:0@lo:103: 00000100:00100000:2.0:1788201038.860678:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201038.860739:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b00029c6400/0x72011f792b7867f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b7867fa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.860747:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b00029c6400/0x72011f792b7867f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b7867fa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.860763:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201038.860765:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201038.860766:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201038.860851:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622421504 00000100:00100000:3.0:1788201038.860867:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622421504 00010000:00010000:3.0:1788201038.860945:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0000031c00/0x72011f792b7867fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b7867f3 expref: 11 pid: 5821 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201038.861006:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201038.861020:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+11:3292:x1875064622421504:12345-0@lo:103: 00010000:00010000:0.0:1788201038.861032:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201038.861038:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0000031c00/0x72011f792b7867fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b7867f3 expref: 11 pid: 5821 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.861188:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0000031c00/0x72011f792b7867fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b7867f3 expref: 11 pid: 5821 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.861202:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0000031c00/0x72011f792b7867fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b7867f3 expref: 11 pid: 5821 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.861214:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0000030e00/0x72011f792b7868e1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.861222:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0000030e00/0x72011f792b7868e1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.861235:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0000030e00/0x72011f792b7868e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.861243:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0000030e00/0x72011f792b7868e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.861250:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0000030e00/0x72011f792b7868e1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.861257:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0000030e00/0x72011f792b7868e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.861263:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030e00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201038.861267:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0000030e00/0x72011f792b7868e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.861274:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0000030e00/0x72011f792b7868e1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.861297:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0000030e00/0x72011f792b7868e1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.861307:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201038.861341:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+10:3292:x1875064622421504:12345-0@lo:103: Request processed in 327us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201038.861348:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201038.863609:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622421504:0@lo:103: 00010000:00010000:0.0:1788201038.863648:0:5822:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0000030e00/0x72011f792b7868e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.863658:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0000030e00/0x72011f792b7868e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.863665:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0000030e00/0x72011f792b7868e1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201038.863682:0:5822:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788201038.912466:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+9:6672:x1875064622420736:12345-0@lo:253: Request processed in 71623us (71859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201038.912481:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201038.914057:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005135c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622420736:0@lo:253: 10000000:01000000:2.0:1788201038.914077:0:6672:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788201038.914080:0:6672:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201038.914082:0:6672:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201038.914083:0:6672:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201038.914084:0:6672:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788201038.914085:0:6672:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201038.914087:0:6672:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201038.914088:0:6672:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201038.914090:0:6672:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788201038.914091:0:6672:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201038.914092:0:6672:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788201038.914115:0:6672:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b0010346000 from lustre-OST0000 10000000:01000000:2.0:1788201038.914212:0:6672:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788201038.914216:0:6672:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788201038.914223:0:6672:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b000701cd40 local copy 10000000:01000000:2.0:1788201038.914227:0:6672:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788201038.914265:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00029c7400/0x72011f792b7868e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.914276:0:6672:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.114@tcp lock: ffff9b00029c7400/0x72011f792b7868e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.914286:0:6672:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b00029c7400/0x72011f792b7868e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201038.914320:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005135c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622421632:0@lo:101: 00000100:00100000:2.0:1788201038.914371:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201038.914432:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f5a76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201038.914447:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622421632 00000100:00100000:1.0:1788201038.914454:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622421632 00000100:00100000:1.0:1788201038.914499:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788201038.914510:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+9:6672:x1875064622421632:12345-0@lo:101: 00010000:00010000:1.0:1788201038.914533:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201038.914585:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0000030e00/0x72011f792b7868ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b7868e8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.914609:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0000030e00/0x72011f792b7868ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b7868e8 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.914619:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0000030e00/0x72011f792b7868ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b7868e8 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.914628:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000030e00, rc 0) 00000100:00100000:0.0:1788201038.914681:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+10:6672:x1875064622421632:12345-0@lo:101: Request processed in 173us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201038.914694:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788201038.914765:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005135c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622421632:0@lo:101: 00010000:00010000:2.0:1788201038.914777:0:6672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b00029c7400/0x72011f792b7868e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x72011f792b7868ef expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.914787:0:6672:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b00029c7400/0x72011f792b7868e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72011f792b7868ef expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201038.914908:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005135c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622421760:0@lo:501: 00000100:00100000:2.0:1788201038.915849:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201038.915890:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f5a76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201038.915912:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622421760 00000100:00100000:1.0:1788201038.915917:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622421760 00000100:00100000:1.0:1788201038.915953:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201038.915962:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+10:6672:x1875064622421760:12345-0@lo:501: 00000100:00100000:1.0:1788201038.916574:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+10:6672:x1875064622421760:12345-0@lo:501: Request processed in 612us (726us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201038.916582:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201038.916723:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005135c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622421760:0@lo:501: 10000000:01000000:2.0:1788201038.916737:0:6672:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788201038.916762:0:6672:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788201038.916767:0:6672:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00029c7400/0x72011f792b7868e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72011f792b7868ef expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.916775:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00029c7400/0x72011f792b7868e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72011f792b7868ef expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.916779:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff9b00029c7400/0x72011f792b7868e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72011f792b7868ef expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.916794:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788201038.916821:0:6672:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b0010346000 00010000:00010000:1.0:1788201038.916821:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1788201038.916826:0:6672:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788201038.916827:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b00029c7400/0x72011f792b7868e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x72011f792b7868ef expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201038.916830:0:6672:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b000701cd40 10000000:01000000:2.0:1788201038.916832:0:6672:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788201038.916835:0:6672:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9b000701cd40 from 1 00010000:00010000:1.0:1788201038.916835:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7400 already unused, calling callback (ffffffffc1ca8c20) 10000000:01000000:2.0:1788201038.916838:0:6672:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 10000000:00010000:1.0:1788201038.916838:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b00029c7400/0x72011f792b7868e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x72011f792b7868ef expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.916845:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b00029c7400/0x72011f792b7868e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x72011f792b7868ef expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201038.916851:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b00029c7400/0x72011f792b7868e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x72011f792b7868ef expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201038.916867:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201038.916871:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00029c6400/0x72011f792b7868f6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.916878:0:6672:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b00029c6400/0x72011f792b7868f6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.916883:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b00029c7400/0x72011f792b7868e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x72011f792b7868ef expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.916886:0:6672:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b00029c6400/0x72011f792b7868f6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.916888:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201038.916899:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005135c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622421888:0@lo:101: 00010000:00010000:1.0:1788201038.916918:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b00029c7400/0x72011f792b7868e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x72011f792b7868ef expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.916936:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b00029c7400/0x72011f792b7868e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x72011f792b7868ef expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201038.916937:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201038.916951:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201038.916953:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201038.916954:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201038.916957:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f5a7600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201038.917010:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201038.917023:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622422016:0@lo:103: 00000100:00100000:3.0:1788201038.917527:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201038.917595:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622422016 00000100:00100000:1.0:1788201038.917600:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622422016 00000100:00100000:1.0:1788201038.917641:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201038.917649:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040905c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+10:3292:x1875064622422016:12345-0@lo:103: 00010000:00010000:1.0:1788201038.917660:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201038.917673:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0000030e00/0x72011f792b7868ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72011f792b7868e8 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201038.917674:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622421888 00000100:00100000:0.0:1788201038.917678:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622421888 00010000:00010000:1.0:1788201038.917689:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201038.917703:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201038.917710:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+10:6672:x1875064622421888:12345-0@lo:101: 00000100:00100000:1.0:1788201038.917719:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040905c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+10:3292:x1875064622422016:12345-0@lo:103: Request processed in 72us (194us total) trans 0 rc 0/0 00010000:00010000:0.0:1788201038.917721:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788201038.917725:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788201038.917732:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0000031c00/0x72011f792b7868fd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b7868f6 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.917748:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0000031c00/0x72011f792b7868fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b7868f6 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201038.917750:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622422016:0@lo:103: 00010000:00010000:0.0:1788201038.917757:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0000031c00/0x72011f792b7868fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b7868f6 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.917764:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000031c00, rc 0) 00000100:00100000:0.0:1788201038.917800:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+10:6672:x1875064622421888:12345-0@lo:101: Request processed in 91us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201038.917806:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201038.917854:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005135c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622421888:0@lo:101: 00010000:00010000:1.0:1788201038.917874:0:6672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b00029c6400/0x72011f792b7868f6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7868fd expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.917883:0:6672:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b00029c6400/0x72011f792b7868f6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b7868fd expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201038.917896:0:6672:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788201038.917919:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00029c6400/0x72011f792b7868f6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7868fd expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.917926:0:6672:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b00029c6400/0x72011f792b7868f6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7868fd expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201038.917933:0:6672:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788201038.917937:0:6672:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201038.917942:0:6672:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788201038.917944:0:6672:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788201038.917960:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786904 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.917967:0:6672:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786904 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.917973:0:6672:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786904 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201038.917985:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622422144:0@lo:101: 00000100:00100000:1.0:1788201038.918011:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201038.918733:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622422144 00000100:00100000:3.0:1788201038.918739:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622422144 00000100:00100000:1.0:1788201038.918739:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000391b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201038.918773:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788201038.918781:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+10:6672:x1875064622422144:12345-0@lo:101: 00010000:00010000:3.0:1788201038.918789:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201038.918801:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b00126fdc00/0x72011f792b78690b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786904 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.918821:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00126fdc00/0x72011f792b78690b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786904 expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.918837:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b00126fdc00/0x72011f792b78690b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786904 expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.918844:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fdc00, rc 0) 00000100:00100000:3.0:1788201038.918897:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+11:6672:x1875064622422144:12345-0@lo:101: Request processed in 116us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201038.918903:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201038.919745:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622422144:0@lo:101: 00010000:00010000:1.0:1788201038.919760:0:6672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786904 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b78690b expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.919771:0:6672:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786904 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b78690b expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201038.919886:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622422272:0@lo:501: 00000100:00100000:1.0:1788201038.919928:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201038.919958:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000391b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201038.920227:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622422272 00000100:00100000:0.0:1788201038.920233:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622422272 00000100:00100000:0.0:1788201038.920275:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201038.920283:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+11:6672:x1875064622422272:12345-0@lo:501: 00000100:00100000:0.0:1788201038.920521:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+11:6672:x1875064622422272:12345-0@lo:501: Request processed in 238us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201038.920529:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201038.920544:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622422272:0@lo:501: 00000100:00100000:1.0:1788201038.920732:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622422400:0@lo:503: 00000100:00100000:1.0:1788201038.920773:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201038.921260:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000391b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201038.923699:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622422400 00000100:00100000:3.0:1788201038.923712:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622422400 00000100:00100000:3.0:1788201038.923761:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788201038.923769:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+11:6672:x1875064622422400:12345-0@lo:503: 00000100:00100000:3.0:1788201038.924001:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+11:6672:x1875064622422400:12345-0@lo:503: Request processed in 232us (3228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201038.924009:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201038.929419:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622422400:0@lo:503: 00000040:00080000:1.0:1788201038.929765:0:6672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201038.929849:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622422528:0@lo:502: 00000100:00100000:1.0:1788201038.929932:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201038.929968:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000391b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201038.930015:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622422528 00000100:00100000:2.0:1788201038.930023:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622422528 00000100:00100000:2.0:1788201038.930074:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788201038.930084:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+11:6672:x1875064622422528:12345-0@lo:502: 00000100:00100000:2.0:1788201038.930307:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+11:6672:x1875064622422528:12345-0@lo:502: Request processed in 223us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201038.930316:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201038.930715:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622422528:0@lo:502: 00000040:00080000:1.0:1788201038.931002:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788201038.931047:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788201038.931073:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788201038.931111:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788201038.931163:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788201038.931205:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788201038.931231:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622422656:0@lo:502: 00000100:00100000:1.0:1788201038.931270:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201038.931403:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000391b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201038.933356:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622422656 00000100:00100000:0.0:1788201038.933370:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622422656 00000100:00100000:0.0:1788201038.933556:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788201038.933566:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+11:6672:x1875064622422656:12345-0@lo:502: 00000100:00100000:0.0:1788201038.933832:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+11:6672:x1875064622422656:12345-0@lo:502: Request processed in 267us (2560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201038.933840:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201038.933957:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622422656:0@lo:502: 00000040:00080000:1.0:1788201038.934104:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788201038.934118:0:6672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788201038.935682:0:6692:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201038.935693:0:6692:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788201038.935709:0:6692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201038.935711:0:6692:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788201038.935720:0:6692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201038.935734:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b0010a4cd40) 00000020:00000080:1.0:1788201038.935754:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788201038.935761:0:6692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788201038.935819:0:6692:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b0010346000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788201038.935827:0:6692:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788201038.935834:0:6692:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72011f792b786919 00010000:00010000:0.0:1788201038.941332:0:6692:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788201038.941879:0:6692:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788201038.945651:0:6692:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788201038.945940:0:6692:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788201038.957016:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788201038.958099:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788201038.962639:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788201038.962651:0:6692:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201038.962658:0:6692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201038.962661:0:6692:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788201038.962665:0:6692:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201038.962668:0:6692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201038.962670:0:6692:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788201038.962673:0:6692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201038.962675:0:6692:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788201038.962726:0:6692:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201038.962730:0:6692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201038.962731:0:6692:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788201038.962735:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788201038.962883:0:6672:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788201038.962912:0:6672:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788201038.962935:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786904 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b78690b expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.962948:0:6672:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b78690b expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201038.962956:0:6672:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b0010346000 from 1 10000000:01000000:1.0:1788201038.962959:0:6672:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201038.962992:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b786920 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.963001:0:6672:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b786920 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.963012:0:6672:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b786920 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201038.963035:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622422784:0@lo:101: 00000100:00100000:1.0:1788201038.963098:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201038.963173:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000391b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201038.963439:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622422784 00000100:00100000:2.0:1788201038.963447:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622422784 00000100:00100000:2.0:1788201038.963492:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788201038.963501:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+11:6672:x1875064622422784:12345-0@lo:101: 00010000:00010000:2.0:1788201038.963514:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201038.963533:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b00029c7800/0x72011f792b786927 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786920 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.963555:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00029c7800/0x72011f792b786927 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786920 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.963565:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b00029c7800/0x72011f792b786927 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786920 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.963575:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c7800, rc 0) 00000100:00100000:2.0:1788201038.963622:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+12:6672:x1875064622422784:12345-0@lo:101: Request processed in 122us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201038.963629:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201038.963791:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622422784:0@lo:101: 00010000:00010000:3.0:1788201038.963813:0:6672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b786920 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786927 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.963823:0:6672:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b786920 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786927 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201038.963935:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040904000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622422912:0@lo:501: 00000100:00100000:3.0:1788201038.963962:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201038.963987:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0033212780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201038.964525:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622422912 00000100:00100000:2.0:1788201038.964531:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622422912 00000100:00100000:2.0:1788201038.964565:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788201038.964573:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+12:6672:x1875064622422912:12345-0@lo:501: 00000100:00100000:2.0:1788201038.965672:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+12:6672:x1875064622422912:12345-0@lo:501: Request processed in 1096us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201038.965682:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201038.966710:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040904000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622422912:0@lo:501: 00000100:00100000:1.0:1788201038.966767:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622423040:0@lo:503: 00000100:00100000:1.0:1788201038.966827:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201038.966910:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000391bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201038.972264:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622423040 00000100:00100000:0.0:1788201038.972281:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622423040 00000100:00100000:0.0:1788201038.972338:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788201038.972349:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+12:6672:x1875064622423040:12345-0@lo:503: 00000100:00100000:0.0:1788201038.972816:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+12:6672:x1875064622423040:12345-0@lo:503: Request processed in 468us (5988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201038.972825:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788201038.972939:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622423040:0@lo:503: 00000040:00080000:1.0:1788201038.973267:0:6672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201038.973358:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622423168:0@lo:502: 00000100:00100000:1.0:1788201038.973401:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201038.973579:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622423168 00000100:00100000:2.0:1788201038.973584:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622423168 00000100:00100000:2.0:1788201038.973612:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201038.973620:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+12:6672:x1875064622423168:12345-0@lo:502: 00000100:00100000:2.0:1788201038.973763:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+12:6672:x1875064622423168:12345-0@lo:502: Request processed in 142us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201038.973770:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788201038.973897:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000391bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201038.973912:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622423168:0@lo:502: 00000040:00080000:1.0:1788201038.974812:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788201038.974910:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788201038.976130:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622423296:0@lo:502: 00000100:00100000:1.0:1788201038.976302:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201038.976441:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000391bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201038.976799:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622423296 00000100:00100000:0.0:1788201038.976806:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622423296 00000100:00100000:0.0:1788201038.976846:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788201038.976853:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+12:6672:x1875064622423296:12345-0@lo:502: 00000100:00100000:1.0:1788201038.977635:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+12:6672:x1875064622423296:12345-0@lo:502: Request processed in 778us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201038.977644:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201038.977729:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622423296:0@lo:502: 00000040:00080000:3.0:1788201038.978051:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788201038.978066:0:6672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788201038.982941:0:6696:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201038.982956:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201038.982959:0:6696:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788201038.982965:0:6696:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b0010346000 00000020:00000080:1.0:1788201038.982968:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788201038.982990:0:6696:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201038.982994:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201038.982995:0:6696:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788201038.982998:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788201038.983352:0:6672:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788201038.983375:0:6672:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201038.983389:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b786920 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786927 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.983400:0:6672:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b786920 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786927 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201038.983438:0:6672:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788201038.983441:0:6672:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b0010346000 10000000:01000000:3.0:1788201038.983444:0:6672:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b0010346000 10000000:01000000:3.0:1788201038.983448:0:6672:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201038.983453:0:6672:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b0010346000 from 1 10000000:01000000:3.0:1788201038.983455:0:6672:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201038.983487:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b78692e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.983507:0:6672:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b78692e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.983519:0:6672:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b78692e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201038.983542:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040905500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622423424:0@lo:101: 00000100:00100000:3.0:1788201038.983604:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201038.984013:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0007f7f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201038.984542:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622423424 00000100:00100000:2.0:1788201038.984551:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622423424 00000100:00100000:2.0:1788201038.984604:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201038.984614:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+12:6672:x1875064622423424:12345-0@lo:101: 00010000:00010000:2.0:1788201038.984627:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201038.984642:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b00029c6000/0x72011f792b786935 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b78692e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.984664:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00029c6000/0x72011f792b786935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b78692e expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.984675:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b00029c6000/0x72011f792b786935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b78692e expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.984683:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c6000, rc 0) 00000100:00100000:2.0:1788201038.984733:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:6672:x1875064622423424:12345-0@lo:101: Request processed in 120us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201038.984739:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201038.984811:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040905500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622423424:0@lo:101: 00010000:00010000:3.0:1788201038.984825:0:6672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b78692e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786935 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201038.984834:0:6672:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b78692e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786935 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201038.984943:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040905500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622423552:0@lo:501: 00000100:00100000:3.0:1788201038.984971:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201038.985000:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0007f7f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201038.985485:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622423552 00000100:00100000:1.0:1788201038.985497:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622423552 00000100:00100000:1.0:1788201038.985522:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788201038.985528:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+13:6672:x1875064622423552:12345-0@lo:501: 00000100:00100000:1.0:1788201038.985741:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+13:6672:x1875064622423552:12345-0@lo:501: Request processed in 213us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201038.985748:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201038.985807:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040905500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622423552:0@lo:501: 00000100:00100000:3.0:1788201038.985833:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040905500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622423680:0@lo:503: 00000100:00100000:3.0:1788201038.985882:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201038.985910:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0007f7f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201038.985960:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622423680 00000100:00100000:2.0:1788201038.985964:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622423680 00000100:00100000:2.0:1788201038.985992:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201038.985998:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:6672:x1875064622423680:12345-0@lo:503: 00000100:00100000:2.0:1788201038.986629:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:6672:x1875064622423680:12345-0@lo:503: Request processed in 629us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201038.986637:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201038.986711:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040905500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622423680:0@lo:503: 00000040:00080000:3.0:1788201038.986987:0:6672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201038.987769:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040905500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622423808:0@lo:502: 00000100:00100000:3.0:1788201038.987822:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201038.987846:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0007f7f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201038.987915:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622423808 00000100:00100000:0.0:1788201038.987921:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622423808 00000100:00100000:0.0:1788201038.987967:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788201038.987975:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+13:6672:x1875064622423808:12345-0@lo:502: 00000100:00100000:0.0:1788201038.988192:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+13:6672:x1875064622423808:12345-0@lo:502: Request processed in 216us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201038.988204:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788201038.988415:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040905500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622423808:0@lo:502: 00000040:00080000:3.0:1788201038.988689:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788201038.988747:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788201038.988782:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788201038.988828:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788201038.988884:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788201038.988935:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788201038.988974:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788201038.989005:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788201038.989587:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788201038.989639:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788201038.989675:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788201038.989726:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788201038.989764:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788201038.989798:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788201038.989845:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788201038.989893:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788201038.989923:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788201038.989971:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788201038.990009:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788201038.990381:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788201038.990438:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788201038.990477:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788201038.990539:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788201038.990608:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788201038.990646:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788201038.990682:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788201038.990731:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788201038.990781:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788201038.990966:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040905500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622423936:0@lo:502: 00000100:00100000:3.0:1788201038.991285:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201038.991329:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0007f7f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201038.991395:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622423936 00000100:00100000:0.0:1788201038.991402:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622423936 00000100:00100000:0.0:1788201038.991509:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788201038.991520:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:6672:x1875064622423936:12345-0@lo:502: 00000100:00100000:0.0:1788201038.991792:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:6672:x1875064622423936:12345-0@lo:502: Request processed in 274us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201038.991799:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788201038.992249:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040905500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622423936:0@lo:502: 00000040:00080000:3.0:1788201038.992339:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788201038.992352:0:6672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788201038.993362:0:6697:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788201038.993377:0:6697:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b00056999c0) 00000020:00000080:0.0:1788201038.993396:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788201038.993591:0:6697:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b0010346000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788201038.993595:0:6697:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b0010346000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788201038.993597:0:6697:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b0010346000 3 00010000:00080000:0.0:1788201038.993620:0:6697:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b003f8f4800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.114@tcp at head 00010000:00010000:1.0:1788201038.999958:0:6697:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788201039.000272:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788201039.000324:0:6697:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201039.000336:0:6697:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x72011f792b786943 00000100:00080000:1.0:1788201039.000346:0:6697:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201039.000352:0:6697:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b003f8f4800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788201039.000382:0:6697:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b0040678e00 x1875064622424064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201039.000452:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1875064622424064:0@lo:38: 00000100:00100000:3.0:1788201039.000513:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201039.000567:0:6697:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788201039.000622:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622424192:0@lo:400: 00000100:00100000:1.0:1788201039.000647:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201039.000683:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622424064 00000100:00100000:1.0:1788201039.000690:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622424064 00000100:00100000:1.0:1788201039.000713:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622424192 00000100:00100000:1.0:1788201039.000716:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622424192 00000100:00100000:1.0:1788201039.000742:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201039.000751:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622424192:12345-0@lo:400: 00000100:00100000:1.0:1788201039.000800:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622424192:12345-0@lo:400: Request processed in 50us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201039.000807:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201039.000820:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201039.000825:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3291:x1875064622424064:12345-0@lo:38: 00010000:00080000:1.0:1788201039.000868:0:5828:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 118 last 0 00000020:00000080:1.0:1788201039.000895:0:5828:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x72011f792b78694a 00000004:00100000:1.0:1788201039.000908:0:5828:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201039.000935:0:5828:0:(import.c:65:import_set_state_nolock()) ffff9b003f5e3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201039.003104:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875064622424064:12345-0@lo:38: Request processed in 2271us (2584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201039.003116:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788201039.003175:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b0040678a80 x1875064622424192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788201039.003181:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b0040678e00 x1875064622424064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201039.003190:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:1.0:1788201039.003190:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622424192:0@lo:400: 00000100:00080000:3.0:1788201039.003198:0:3291:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788201039.003206:0:3291:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788201039.003211:0:3291:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788201039.003214:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b003f8f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201039.003268:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1875064622424064:0@lo:38: 00000040:00080000:1.0:1788201039.003745:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788201039.003985:0:6672:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788201039.004013:0:6672:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201039.004343:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b78692e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786935 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201039.004355:0:6672:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b78692e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786935 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788201039.004459:0:6672:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788201039.004461:0:6672:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201039.004462:0:6672:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201039.004463:0:6672:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201039.004464:0:6672:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201039.004466:0:6672:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201039.004467:0:6672:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201039.004469:0:6672:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788201039.004470:0:6672:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788201039.004472:0:6672:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201039.004473:0:6672:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201039.004476:0:6672:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788201039.004478:0:6672:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201039.004480:0:6672:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201039.004481:0:6672:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201039.004482:0:6672:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201039.004483:0:6672:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201039.004484:0:6672:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201039.004485:0:6672:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201039.004486:0:6672:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788201039.004487:0:6672:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788201039.004488:0:6672:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201039.004494:0:6672:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201039.004514:0:6672:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788201039.004529:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622424320:0@lo:253: 00000100:00100000:1.0:1788201039.004586:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201039.004624:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000391bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201039.004683:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622424320 00000100:00100000:0.0:1788201039.004689:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622424320 00000100:00100000:0.0:1788201039.004732:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201039.004741:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+13:6672:x1875064622424320:12345-0@lo:253: 20000000:01000000:0.0:1788201039.004765:0:5819:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788201039.004784:0:5819:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788201039.034738:0:5819:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788201039.034778:0:5819:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788201039.035919:0:5843:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201039.035926:0:5843:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201039.035947:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b00029c7600/0x72011f792b786951 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.035965:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0001681000/0x72011f792b7868b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b7868a9 expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.035987:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b00029c7600/0x72011f792b786951 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.036024:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0001681000/0x72011f792b7868b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b7868a9 expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.036038:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b0001681000/0x72011f792b7868b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b7868a9 expref: 13 pid: 5821 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201039.036052:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005135f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5843:1875064622424448:0@lo:104: 00000100:00100000:2.0:1788201039.036128:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201039.036192:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f5a7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201039.036416:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622424448 00000100:00100000:1.0:1788201039.036424:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622424448 00000100:00100000:1.0:1788201039.036474:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201039.036484:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16f590af-689d-4459-b486-809c9db65822+3:5843:x1875064622424448:12345-0@lo:104: 00010000:00010000:1.0:1788201039.036495:0:5811:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b7868a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b7868b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201039.036544:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201039.036551:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16f590af-689d-4459-b486-809c9db65822+3:5843:x1875064622424448:12345-0@lo:104: Request processed in 69us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201039.036557:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788201039.036577:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201039.036583:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b7868a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b7868b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201039.036590:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030c00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1788201039.036595:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b7868a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b7868b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201039.036602:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b7868a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b7868b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201039.036609:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b7868a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b7868b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201039.036622:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201039.036649:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b7868a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b7868b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201039.036655:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201039.036671:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b7868a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b7868b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201039.036677:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b7868a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b7868b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201039.036693:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201039.036694:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201039.036696:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201039.036715:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622424576:0@lo:103: 00000100:00100000:1.0:1788201039.036758:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201039.036798:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622424576 00000100:00100000:1.0:1788201039.036802:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622424576 00010000:00010000:1.0:1788201039.036817:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0001681000/0x72011f792b7868b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b7868a9 expref: 14 pid: 5821 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201039.036838:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201039.036844:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000679c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+14:3295:x1875064622424576:12345-0@lo:103: 00010000:00010000:1.0:1788201039.036853:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201039.036868:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0001681000/0x72011f792b7868b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b7868a9 expref: 14 pid: 5821 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201039.036879:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0001681000/0x72011f792b7868b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b7868a9 expref: 14 pid: 5821 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201039.036901:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b00029c7600/0x72011f792b786951 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201039.036908:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00029c7600/0x72011f792b786951 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201039.036921:0:5814:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001460606s 00010000:00010000:1.0:1788201039.036925:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b00029c7600/0x72011f792b786951 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201039.036932:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b00029c7600/0x72011f792b786951 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201039.036939:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b00029c7600/0x72011f792b786951 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201039.036944:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b00029c7600/0x72011f792b786951 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201039.036950:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7600 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201039.036954:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b00029c7600/0x72011f792b786951 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201039.036962:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b00029c7600/0x72011f792b786951 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201039.036970:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b00029c7600/0x72011f792b786951 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201039.036979:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201039.037007:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000679c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+14:3295:x1875064622424576:12345-0@lo:103: Request processed in 163us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201039.037019:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201039.037178:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622424576:0@lo:103: 00010000:00010000:2.0:1788201039.037471:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0001681000/0x72011f792b7868b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b7868a9 expref: 13 pid: 5821 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201039.037484:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005135f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5843:1875064622424448:0@lo:104: 00010000:00010000:2.0:1788201039.037497:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b00029c7600/0x72011f792b786951 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.037504:0:5843:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b00029c7600/0x72011f792b786951 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.037509:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b00029c7600/0x72011f792b786951 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.037515:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00029c7600/0x72011f792b786951 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201039.041853:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+12:6672:x1875064622424320:12345-0@lo:253: Request processed in 37104us (37256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201039.041876:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788201039.042024:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:6672:1875064622424320:0@lo:253: 10000000:01000000:1.0:1788201039.042038:0:6672:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788201039.042041:0:6672:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201039.042043:0:6672:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201039.042044:0:6672:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201039.042046:0:6672:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201039.042047:0:6672:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201039.042048:0:6672:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201039.042050:0:6672:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201039.042051:0:6672:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788201039.042052:0:6672:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788201039.042054:0:6672:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201039.042055:0:6672:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788201039.042079:0:6672:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788201039.047552:0:6672:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201039.047733:0:6672:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788201039.047968:0:6672:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201039.048493:0:6672:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788201039.048716:0:6672:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201039.048954:0:6672:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788201039.052815:0:6672:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788201039.261833:0:6672:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788201039.261847:0:6672:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788201039.261893:0:6672:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788201039.261941:0:6672:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.114@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788201039.261960:0:6672:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788201039.261986:0:6672:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788201039.308468:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201040.331450:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201041.355873:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201042.381327:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201043.403405:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201044.172213:0:7041:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788201044.237943:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622424960:0@lo:400: 00000100:00100000:0.0:1788201044.238016:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201044.238108:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622424960 00000100:00100000:0.0:1788201044.238115:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622424960 00000100:00100000:1.0:1788201044.238628:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622424704:0@lo:400: 00000100:00100000:1.0:1788201044.238665:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201044.238707:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201044.238714:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622424832:0@lo:400: 00000100:00100000:1.0:1788201044.238739:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201044.238764:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201044.238812:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622424832 00000100:00100000:1.0:1788201044.238816:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622424832 00000100:00100000:1.0:1788201044.238851:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201044.238860:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622424960:12345-0@lo:400: 00000100:00100000:1.0:1788201044.238913:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622424960:12345-0@lo:400: Request processed in 54us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201044.238920:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201044.238937:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201044.238943:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622424832:12345-0@lo:400: 00000100:00100000:1.0:1788201044.238975:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622424832:12345-0@lo:400: Request processed in 33us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201044.238981:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788201044.239013:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b002722ca80 x1875064622424832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201044.239027:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622424832:0@lo:400: 00000100:00100000:0.0:1788201044.239098:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622424704 00000100:00100000:0.0:1788201044.239102:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622424704 00000100:00100000:0.0:1788201044.239153:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201044.239161:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+12:3292:x1875064622424704:12345-0@lo:400: 00000100:00100000:0.0:1788201044.240051:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+12:3292:x1875064622424704:12345-0@lo:400: Request processed in 886us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201044.240060:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201044.240104:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622424704:0@lo:400: 00010000:00080000:0.0:1788201044.240689:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b002722ed80 x1875064622424960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201044.240705:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622424960:0@lo:400: 00010000:00010000:1.0:1788201044.430895:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201045.460354:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201046.475368:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788201047.307210:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788201047.307218:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b0007c1d000 from 21 10000000:01000000:1.0:1788201047.307223:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201047.307270:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681600/0x72011f792b786958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.307283:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0001681600/0x72011f792b786958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.307309:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0001681600/0x72011f792b786958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201047.307335:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622425088:0@lo:101: 00000100:00100000:1.0:1788201047.307404:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.307468:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f8d6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201047.307701:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622425088 00000100:00100000:0.0:1788201047.307709:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622425088 00000100:00100000:0.0:1788201047.307764:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201047.307775:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+12:5825:x1875064622425088:12345-0@lo:101: 00010000:00010000:0.0:1788201047.307792:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201047.307816:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0000030400/0x72011f792b78695f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786958 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.307853:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0000030400/0x72011f792b78695f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786958 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.307864:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0000030400/0x72011f792b78695f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786958 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.307874:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000030400, rc 0) 00000100:00100000:0.0:1788201047.307924:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+13:5825:x1875064622425088:12345-0@lo:101: Request processed in 150us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201047.307930:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788201047.308186:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622425088:0@lo:101: 00010000:00010000:1.0:1788201047.308200:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0001681600/0x72011f792b786958 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b78695f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.308211:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0001681600/0x72011f792b786958 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b78695f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201047.308268:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622425216:0@lo:501: 00000100:00100000:1.0:1788201047.308295:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.308313:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f8d6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201047.308329:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622425216 00000100:00100000:1.0:1788201047.308332:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622425216 00000100:00100000:1.0:1788201047.308358:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788201047.308365:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0009fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+13:5825:x1875064622425216:12345-0@lo:501: 00000100:00100000:1.0:1788201047.308766:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0009fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+13:5825:x1875064622425216:12345-0@lo:501: Request processed in 400us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.308774:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788201047.308823:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622425216:0@lo:501: 00000100:00100000:1.0:1788201047.308851:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622425344:0@lo:503: 00000100:00100000:1.0:1788201047.308901:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.308929:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f8d6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201047.308943:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622425344 00000100:00100000:1.0:1788201047.308946:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622425344 00000100:00100000:1.0:1788201047.308972:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201047.308979:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0009fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:5825:x1875064622425344:12345-0@lo:503: 00000100:00100000:1.0:1788201047.309306:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0009fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:5825:x1875064622425344:12345-0@lo:503: Request processed in 326us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.309315:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201047.309374:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622425344:0@lo:503: 00000100:00100000:1.0:1788201047.309555:0:7196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7196:1875064622425472:0@lo:502: 00000100:00100000:1.0:1788201047.309613:0:7196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.309636:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622425472 00000100:00100000:1.0:1788201047.309640:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622425472 00000100:00100000:1.0:1788201047.309667:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201047.309675:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0009fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+13:7196:x1875064622425472:12345-0@lo:502: 00000100:00100000:1.0:1788201047.309900:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0009fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+13:7196:x1875064622425472:12345-0@lo:502: Request processed in 226us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.309907:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201047.309945:0:7196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f8d6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201047.309957:0:7196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7196:1875064622425472:0@lo:502: 00000100:00100000:1.0:1788201047.309997:0:7196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7196:1875064622425600:0@lo:502: 00000100:00100000:1.0:1788201047.310028:0:7196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.310049:0:7196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f8d6600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201047.310203:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622425600 00000100:00100000:0.0:1788201047.310208:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622425600 00000100:00100000:0.0:1788201047.310456:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788201047.310464:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00109dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+13:7196:x1875064622425600:12345-0@lo:502: 00000100:00100000:0.0:1788201047.310619:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00109dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+13:7196:x1875064622425600:12345-0@lo:502: Request processed in 155us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201047.310627:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201047.311172:0:7196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7196:1875064622425600:0@lo:502: 00000040:00080000:1.0:1788201047.311210:0:7196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788201047.311502:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788201047.311524:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201047.311534:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681600/0x72011f792b786958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b78695f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.311546:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0001681600/0x72011f792b786958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b78695f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201047.311556:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788201047.311559:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b0007c1d000 from 4 10000000:01000000:0.0:1788201047.311562:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201047.311598:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b786966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.311606:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b786966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.311615:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b786966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201047.311632:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622425728:0@lo:101: 00000100:00100000:0.0:1788201047.311675:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201047.311710:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003584d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201047.311763:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622425728 00000100:00100000:1.0:1788201047.311769:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622425728 00000100:00100000:1.0:1788201047.311812:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201047.311819:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00109de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:5825:x1875064622425728:12345-0@lo:101: 00010000:00010000:1.0:1788201047.311828:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201047.311843:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0001680e00/0x72011f792b78696d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786966 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.311863:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0001680e00/0x72011f792b78696d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786966 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.311874:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0001680e00/0x72011f792b78696d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786966 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.311883:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680e00, rc 0) 00000100:00100000:1.0:1788201047.311923:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00109de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+14:5825:x1875064622425728:12345-0@lo:101: Request processed in 104us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.311929:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788201047.312786:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622425728:0@lo:101: 00010000:00010000:0.0:1788201047.312812:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b786966 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b78696d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.312821:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b786966 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b78696d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201047.312879:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622425856:0@lo:256: 00000100:00100000:0.0:1788201047.312919:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201047.312954:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003584d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201047.313323:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622425856 00000100:00100000:1.0:1788201047.313330:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622425856 00000100:00100000:1.0:1788201047.313374:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788201047.313383:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+14:5825:x1875064622425856:12345-0@lo:256: 20000000:01000000:1.0:1788201047.313401:0:5819:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788201047.313419:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201047.313528:0:5819:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788201047.313636:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+14:5825:x1875064622425856:12345-0@lo:256: Request processed in 253us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.313643:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788201047.313769:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622425856:0@lo:256: 10000000:01000000:0.0:1788201047.313820:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201047.313828:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b786966 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b78696d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.313838:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b786966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b78696d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201047.313852:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788201047.313855:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788201047.313857:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788201047.313879:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.313887:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.313896:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201047.313910:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622425984:0@lo:101: 00000100:00100000:0.0:1788201047.313940:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201047.313973:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003584d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201047.325653:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622425984 00000100:00100000:2.0:1788201047.325674:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622425984 00000100:00100000:2.0:1788201047.325747:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788201047.325760:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+14:5825:x1875064622425984:12345-0@lo:101: 00010000:00010000:2.0:1788201047.325779:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201047.325808:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b00029c7e00/0x72011f792b78697b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786974 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201047.325836:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00029c7e00/0x72011f792b78697b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786974 expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201047.325850:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b00029c7e00/0x72011f792b78697b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786974 expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201047.325859:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c7e00, rc 0) 00000100:00100000:2.0:1788201047.325952:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+15:5825:x1875064622425984:12345-0@lo:101: Request processed in 195us (12011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201047.325960:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201047.326403:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622425984:0@lo:101: 00010000:00010000:0.0:1788201047.326422:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786974 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b78697b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.326511:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786974 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b78697b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201047.326677:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622426112:0@lo:501: 00000100:00100000:0.0:1788201047.326719:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201047.326814:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003584d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201047.329283:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622426112 00000100:00100000:1.0:1788201047.329296:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622426112 00000100:00100000:1.0:1788201047.329381:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201047.329390:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+15:5825:x1875064622426112:12345-0@lo:501: 00000100:00100000:1.0:1788201047.329701:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+15:5825:x1875064622426112:12345-0@lo:501: Request processed in 312us (2982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.329710:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788201047.330449:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622426112:0@lo:501: 00000100:00100000:0.0:1788201047.330499:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622426240:0@lo:503: 00000100:00100000:0.0:1788201047.330762:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201047.330823:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003584d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201047.330900:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622426240 00000100:00100000:2.0:1788201047.330907:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622426240 00000100:00100000:2.0:1788201047.330956:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201047.330966:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+15:5825:x1875064622426240:12345-0@lo:503: 00000100:00100000:2.0:1788201047.331342:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+15:5825:x1875064622426240:12345-0@lo:503: Request processed in 377us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201047.331357:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201047.331413:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622426240:0@lo:503: 00000100:00100000:0.0:1788201047.341820:0:7198:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7198:1875064622426368:0@lo:502: 00000100:00100000:0.0:1788201047.341912:0:7198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201047.343354:0:7198:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003584d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201047.345251:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622426368 00000100:00100000:2.0:1788201047.345262:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622426368 00000100:00100000:2.0:1788201047.345356:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788201047.345368:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+15:7198:x1875064622426368:12345-0@lo:502: 00000100:00100000:2.0:1788201047.345772:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+15:7198:x1875064622426368:12345-0@lo:502: Request processed in 406us (3859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201047.345782:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788201047.350877:0:7198:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7198:1875064622426368:0@lo:502: 00000020:01000000:0.0:1788201047.350932:0:7198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788201047.350941:0:7198:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788201047.350949:0:7198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201047.350951:0:7198:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788201047.350961:0:7198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788201047.350965:0:7198:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:01000000:0.0:1788201047.350989:0:7198:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788201047.350992:0:7198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201047.351008:0:7198:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b0005698000) 00000020:00000080:0.0:1788201047.351030:0:7198:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788201047.351037:0:7198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788201047.351151:0:7198:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788201047.351158:0:7198:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788201047.351171:0:7198:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72011f792b786989 00010000:00080000:0.0:1788201047.351204:0:7198:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b0040946800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.114@tcp at head 00010000:00010000:0.0:1788201047.351452:0:7198:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788201047.419510:0:7198:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788201047.419535:0:7198:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788201047.420113:0:7198:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201047.420514:0:7198:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201047.420568:0:7198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788201047.420632:0:7198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788201047.425700:0:7208:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788201047.425709:0:7208:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788201047.426493:0:7198:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201047.426511:0:7198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788201047.426540:0:7198:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788201047.426559:0:7198:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72011f792b786990 00000100:00080000:0.0:1788201047.426568:0:7198:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201047.426574:0:7198:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b0040946800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788201047.426607:0:7198:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b002722c000 x1875064622426496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201047.426627:0:7198:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788201047.426684:0:7198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201047.426687:0:7198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201047.426689:0:7198:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788201047.426692:0:7198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201047.426695:0:7198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201047.426697:0:7198:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788201047.426700:0:7198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788201047.426701:0:7198:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788201047.426730:0:7198:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7198:1875064622426624:0@lo:502: 00000100:00100000:0.0:1788201047.426817:0:7198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201047.426864:0:7198:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003584da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201047.427006:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622426752:0@lo:400: 00000100:00100000:0.0:1788201047.427040:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201047.427179:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622426496:0@lo:8: 00000100:00100000:3.0:1788201047.427215:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201047.427245:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201047.427252:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1875064622426880:0@lo:400: 00000100:00100000:3.0:1788201047.427385:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622426496 00000100:00100000:3.0:1788201047.427392:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622426496 00000100:00100000:3.0:1788201047.427420:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201047.427427:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3291:x1875064622426496:12345-0@lo:8: 00010000:00080000:3.0:1788201047.427449:0:6675:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 126 last 0 00000020:00000080:3.0:1788201047.427479:0:6675:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72011f792b786997 00002000:00100000:3.0:1788201047.427510:0:6675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b003f8ec800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788201047.427514:0:6675:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788201047.427518:0:6675:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788201047.427637:0:6675:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788201047.427769:0:6675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788201047.427795:0:6675:0:(import.c:65:import_set_state_nolock()) ffff9b003f8ed800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201047.427861:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3291:x1875064622426496:12345-0@lo:8: Request processed in 432us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201047.427868:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788201047.427913:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b002722c000 x1875064622426496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201047.427924:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201047.427931:0:3291:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788201047.427940:0:3291:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788201047.427944:0:3291:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788201047.427947:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b0040946800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788201047.427962:0:3291:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788201047.427967:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622426496:0@lo:8: 00000100:00100000:1.0:1788201047.431077:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622426624 00000100:00100000:1.0:1788201047.431089:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622426624 00000100:00100000:1.0:1788201047.431225:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788201047.431239:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+15:7198:x1875064622426624:12345-0@lo:502: 00000100:00100000:1.0:1788201047.431512:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+15:7198:x1875064622426624:12345-0@lo:502: Request processed in 276us (4694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.431521:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788201047.431667:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.434334:0:7198:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7198:1875064622426624:0@lo:502: 00000020:01000000:1.0:1788201047.434372:0:7198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201047.434380:0:7198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201047.434382:0:7198:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788201047.434386:0:7198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788201047.434513:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788201047.434531:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788201047.434544:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786974 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b78697b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.434556:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b78697b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201047.434578:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788201047.434581:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b000701cd40 from 1 10000000:01000000:1.0:1788201047.434584:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788201047.434622:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001680a00/0x72011f792b78699e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.434630:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0001680a00/0x72011f792b78699e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.434640:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0001680a00/0x72011f792b78699e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201047.434657:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622427008:0@lo:101: 00000100:00100000:1.0:1788201047.434714:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.434751:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f8d6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201047.434772:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622427008 00000100:00100000:1.0:1788201047.434778:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622427008 00000100:00100000:1.0:1788201047.435281:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201047.435292:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+15:5825:x1875064622427008:12345-0@lo:101: 00010000:00010000:1.0:1788201047.435305:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201047.435320:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0001681e00/0x72011f792b7869a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b78699e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.435344:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0001681e00/0x72011f792b7869a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b78699e expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.435354:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0001681e00/0x72011f792b7869a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b78699e expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.435375:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681e00, rc 0) 00000100:00100000:1.0:1788201047.435417:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+16:5825:x1875064622427008:12345-0@lo:101: Request processed in 128us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.435423:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201047.435465:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622427008:0@lo:101: 00010000:00010000:1.0:1788201047.435477:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0001680a00/0x72011f792b78699e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7869a5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.435486:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0001680a00/0x72011f792b78699e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b7869a5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201047.435537:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622427136:0@lo:501: 00000100:00100000:1.0:1788201047.435569:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.435605:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f8d6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201047.435621:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622427136 00000100:00100000:1.0:1788201047.435625:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622427136 00000100:00100000:1.0:1788201047.435647:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201047.435653:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000506a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+16:5825:x1875064622427136:12345-0@lo:501: 00000100:00100000:1.0:1788201047.435973:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000506a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+16:5825:x1875064622427136:12345-0@lo:501: Request processed in 319us (402us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201047.435980:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201047.436012:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622427136:0@lo:501: 10000000:01000000:1.0:1788201047.436033:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788201047.436040:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001680a00/0x72011f792b78699e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7869a5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.436058:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0001680a00/0x72011f792b78699e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7869a5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201047.436079:0:7208:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788201047.437433:0:7208:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 126562296973ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788201047.438089:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622426752 00000100:00100000:2.0:1788201047.438098:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622426752 00000100:00100000:2.0:1788201047.438184:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622426880 00000100:00100000:2.0:1788201047.438188:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622426880 00000100:00100000:2.0:1788201047.438218:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201047.438227:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622426752:12345-0@lo:400: 00000100:00100000:2.0:1788201047.438314:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622426752:12345-0@lo:400: Request processed in 87us (11272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201047.438320:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201047.438337:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201047.438343:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875064622426880:12345-0@lo:400: 00000100:00100000:2.0:1788201047.438382:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875064622426880:12345-0@lo:400: Request processed in 39us (6715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201047.438388:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788201047.439064:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b0005135f80 x1875064622426752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201047.439080:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622426752:0@lo:400: 00000100:00080000:1.0:1788201047.440303:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788201047.440430:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b0005135500 x1875064622426880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201047.440446:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1875064622426880:0@lo:400: 00000004:00080000:0.0:1788201047.504832:0:7209:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788201047.504869:0:7209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7209:1875064622427392:0@lo:7: 00000100:00100000:0.0:1788201047.504941:0:7209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201047.505006:0:7209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0008b58300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201047.505035:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201047.505046:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622427264:0@lo:13: 00000100:00100000:0.0:1788201047.505072:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201047.505109:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622427392 00000100:00100000:0.0:1788201047.505115:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622427392 00010000:00010000:2.0:1788201047.505631:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201047.506913:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201047.506928:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7209:x1875064622427392:12345-0@lo:7: 00000100:00080000:2.0:1788201047.510317:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201047.510357:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622427264 00000100:00100000:2.0:1788201047.510368:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622427264 00000100:00100000:2.0:1788201047.510428:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201047.510438:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1875064622427264:12345-0@lo:13: 00002000:00000024:2.0:1788201047.510474:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788201047.510558:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1875064622427264:12345-0@lo:13: Request processed in 122us (5485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201047.510566:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788201047.515921:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b002722d500 x1875064622427264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201047.515948:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622427264:0@lo:13: 00002000:00080000:0.0:1788201047.517594:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788201047.517602:0:6678:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788201047.517692:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7209:x1875064622427392:12345-0@lo:7: Request processed in 10767us (12748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201047.517703:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788201047.517763:0:7209:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b002722f100 x1875064622427392/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788201063 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201047.517777:0:7209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7209:1875064622427392:0@lo:7: 00000004:00080000:1.0:1788201047.517791:0:7209:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788201047.517836:0:7209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7209:1875064622427520:0@lo:5: 00000100:00100000:1.0:1788201047.517871:0:7209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.517921:0:7209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f8d6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201047.517944:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622427520 00000100:00100000:1.0:1788201047.517950:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622427520 00000100:00100000:1.0:1788201047.517984:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201047.517991:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7209:x1875064622427520:12345-0@lo:5: 00002000:00080000:1.0:1788201047.518012:0:6677:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788201047.518016:0:6677:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788201047.518240:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7209:x1875064622427520:12345-0@lo:5: Request processed in 248us (368us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788201047.518247:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788201047.518937:0:7209:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b0040678000 x1875064622427520/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201063 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201047.518951:0:7209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7209:1875064622427520:0@lo:5: 00000004:00080000:0.0:1788201047.518960:0:7209:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788201047.518989:0:7209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7209:1875064622427648:0@lo:700: 00000100:00100000:0.0:1788201047.519021:0:7209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201047.519042:0:7209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0008b58c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201047.519311:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622427648 00000100:00100000:1.0:1788201047.519317:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622427648 00000100:00100000:1.0:1788201047.519357:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201047.519365:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7209:x1875064622427648:12345-0@lo:700: 00000100:00100000:1.0:1788201047.519393:0:6684:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040679c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6684:1875064622427776:0@lo:700: 00000100:00100000:1.0:1788201047.519425:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.519444:0:6684:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f8d6900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201047.520786:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622427776 00000100:00100000:2.0:1788201047.520807:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622427776 00000100:00100000:2.0:1788201047.520850:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201047.520858:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6684:x1875064622427776:12345-0@lo:700: 00000004:00080000:0.0:1788201047.551758:0:5849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:2.0:1788201047.583593:0:5834:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788201047.602553:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6684:x1875064622427776:12345-0@lo:700: Request processed in 81686us (83118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201047.602567:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788201047.603539:0:6684:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b0040679c00 x1875064622427776/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788201063 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201047.603556:0:6684:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040679c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6684:1875064622427776:0@lo:700: 40000000:02000000:0.0:1788201047.603573:0:6684:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1788201047.707064:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788201047.707090:0:6702:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788201047.707268:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7209:x1875064622427648:12345-0@lo:700: Request processed in 187900us (188242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201047.707295:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788201047.707429:0:7209:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b002722c380 x1875064622427648/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788201063 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201047.707440:0:7209:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788201047.707455:0:7209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7209:1875064622427648:0@lo:700: 00000004:02000040:1.0:1788201047.771871:0:7209:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788201047.791353:0:7209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7209:1875064622427904:0@lo:5: 00000100:00100000:0.0:1788201047.791429:0:7209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201047.791494:0:7209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0011e356c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201047.793764:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622427904 00000100:00100000:1.0:1788201047.793780:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622427904 00000100:00100000:1.0:1788201047.793861:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201047.793873:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7209:x1875064622427904:12345-0@lo:5: 00002000:00080000:0.0:1788201047.808459:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788201047.808481:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788201047.822157:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7209:x1875064622427904:12345-0@lo:5: Request processed in 28276us (30717us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788201047.822170:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788201047.822825:0:7209:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b002722c700 x1875064622427904/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201063 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201047.822845:0:7209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7209:1875064622427904:0@lo:5: 00000004:00080000:3.0:1788201047.822860:0:7209:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:00080000:2.0:1788201048.295237:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1788201048.523290:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201049.547720:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201050.572232:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201051.597504:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201052.428332:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622428288:0@lo:400: 00000100:00100000:3.0:1788201052.428351:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622428160:0@lo:400: 00000100:00100000:0.0:1788201052.428424:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622428032:0@lo:400: 00000100:00100000:2.0:1788201052.428813:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201052.428874:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201052.428880:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622428416:0@lo:400: 00000100:00100000:2.0:1788201052.428913:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201052.428957:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622428416 00000100:00100000:2.0:1788201052.428963:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622428416 00000100:00100000:2.0:1788201052.429023:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201052.429032:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622428416:12345-0@lo:400: 00000100:00100000:2.0:1788201052.429083:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622428416:12345-0@lo:400: Request processed in 52us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201052.429090:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788201052.429110:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788201052.429155:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b0005137800 x1875064622428416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201052.429166:0:3292:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788201052.429184:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622428416:0@lo:400: 00000100:00100000:1.0:1788201052.429252:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622428288 00000100:00100000:1.0:1788201052.429256:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622428288 00000100:00100000:1.0:1788201052.429293:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201052.429300:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622428288:12345-0@lo:400: 00000100:00080000:2.0:1788201052.429414:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201052.429574:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622428288:12345-0@lo:400: Request processed in 274us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201052.429580:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788201052.429629:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b0005137480 x1875064622428288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201052.429639:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622428288:0@lo:400: 00000100:00100000:3.0:1788201052.436411:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201052.436801:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622428160 00000100:00100000:2.0:1788201052.436811:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622428160 00000100:00100000:2.0:1788201052.436866:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201052.436876:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622428160:12345-0@lo:400: 00000100:00100000:2.0:1788201052.436943:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622428160:12345-0@lo:400: Request processed in 68us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201052.436950:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788201052.436993:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b0005137100 x1875064622428160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201052.437008:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622428160:0@lo:400: 00000100:00100000:2.0:1788201052.447548:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201052.447690:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622428032 00000100:00100000:3.0:1788201052.447699:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622428032 00000100:00100000:3.0:1788201052.447759:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788201052.447777:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000506b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:3294:x1875064622428032:12345-0@lo:400: 00000100:00100000:3.0:1788201052.447849:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000506b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:3294:x1875064622428032:12345-0@lo:400: Request processed in 73us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201052.447856:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788201052.448058:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622428032:0@lo:400: 00010000:00010000:3.0:1788201052.619380:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201052.940310:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201052.940330:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622428544:0@lo:13: 00000100:00100000:1.0:1788201052.940408:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201052.940477:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622428544 00000100:00100000:1.0:1788201052.940483:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622428544 00000100:00100000:1.0:1788201052.940535:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201052.940555:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622428544:12345-0@lo:13: 00002000:00000024:1.0:1788201052.940590:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201052.940634:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622428544:12345-0@lo:13: Request processed in 90us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201052.940640:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788201052.940687:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b0040678000 x1875064622428544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201052.940706:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622428544:0@lo:13: 00010000:00010000:3.0:1788201053.644273:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788201054.365447:0:7624:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788201054.365451:0:7624:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788201054.365582:0:7624:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b003f8e9800 00000020:01000004:3.0:1788201054.365597:0:7624:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788201054.365608:0:7624:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788201054.365620:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b00409399c0) 00000020:00000080:3.0:1788201054.365634:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788201054.379068:0:7624:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788201054.379524:0:7624:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788201054.396359:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788201054.400688:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788201054.400723:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788201054.400793:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788201054.400816:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788201054.401293:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788201054.401305:0:7624:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788201054.401316:0:7624:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72011f792b7869b3 00000020:01000004:3.0:1788201054.401323:0:7624:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788201054.401350:0:7624:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.114@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788201054.401353:0:7624:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788201054.401359:0:7624:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788201054.401379:0:7624:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788201054.401383:0:7624:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.114@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788201054.427041:0:7624:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788201054.427077:0:7624:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.114@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788201054.427081:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788201054.427083:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201054.427084:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201054.427085:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201054.427087:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201054.427088:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201054.427090:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201054.427091:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788201054.427093:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788201054.427094:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201054.427095:0:7624:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201054.427099:0:7624:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788201054.427101:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201054.427103:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201054.427104:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201054.427105:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201054.427106:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201054.427387:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201054.427390:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201054.427391:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788201054.427392:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788201054.427393:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201054.427394:0:7624:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201054.427440:0:7624:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788201054.427457:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622428672:0@lo:253: 00000100:00100000:2.0:1788201054.427524:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201054.427614:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201054.427869:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622428672 00000100:00100000:1.0:1788201054.427877:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622428672 00000100:00100000:1.0:1788201054.427970:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201054.427980:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000506a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+16:7624:x1875064622428672:12345-0@lo:253: 20000000:01000000:1.0:1788201054.428007:0:5822:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788201054.428012:0:5822:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788201054.428017:0:5822:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788201054.428020:0:5822:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788201054.429335:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201054.429536:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788201054.429549:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788201054.429588:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788201054.429595:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788201054.429626:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788201054.432608:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788201054.433179:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788201054.433201:0:5822:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.114@tcp 20000000:01000000:1.0:1788201054.433209:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.114@tcp (null) (null) (null) 00000040:00080000:1.0:1788201054.433252:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788201054.433260:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788201054.433311:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788201054.433319:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.114@tcp (null) (null) 00000040:00080000:1.0:1788201054.433352:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788201054.433361:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788201054.433391:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788201054.433444:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788201054.434186:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788201054.434203:0:5822:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.114@tcp 20000000:01000000:1.0:1788201054.434205:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.114@tcp (null) (null) (null) 00000040:00080000:1.0:1788201054.434239:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788201054.434246:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788201054.434276:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788201054.434284:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.114@tcp (null) (null) 00000040:00080000:1.0:1788201054.434315:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788201054.434324:0:5822:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788201054.434370:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788201054.434410:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788201054.434425:0:5822:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788201054.434428:0:5822:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788201054.434432:0:5822:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788201054.434443:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788201054.434446:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788201054.434478:0:5822:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788201054.434480:0:5822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788201054.435691:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788201054.435769:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788201054.435826:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788201054.436224:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788201054.436271:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788201054.436311:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788201054.436326:0:5822:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788201054.436328:0:5822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788201054.440358:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788201054.440724:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788201054.440800:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788201054.440875:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788201054.440889:0:5822:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788201054.440891:0:5822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788201054.441447:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788201054.441500:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788201054.441558:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788201054.441907:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788201054.441944:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788201054.441997:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788201054.442011:0:5822:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788201054.442013:0:5822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788201054.454271:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788201054.454381:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788201054.454419:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788201054.454911:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788201054.454955:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788201054.455007:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788201054.455023:0:5822:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788201054.455026:0:5822:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788201054.455034:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788201054.455053:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0001681400/0x72011f792b7869ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.455071:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b00126fdc00/0x72011f792b78690b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786904 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.455080:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b00029c6000/0x72011f792b786935 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b78692e expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.455087:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0000030400/0x72011f792b78695f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786958 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.455094:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b00029c7e00/0x72011f792b78697b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786974 expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.455100:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0001681e00/0x72011f792b7869a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b78699e expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.455124:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0001681400/0x72011f792b7869ba lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.455266:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0001681e00/0x72011f792b7869a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b78699e expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.455280:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b0001681e00/0x72011f792b7869a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b78699e expref: 16 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201054.455295:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5822:1875064622428800:0@lo:104: 00000100:00100000:1.0:1788201054.455364:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201054.455452:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b00029c7e00/0x72011f792b78697b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b786974 expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.455461:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b00029c7e00/0x72011f792b78697b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b786974 expref: 16 pid: 5821 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201054.455470:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5822:1875064622428928:0@lo:104: 00010000:00010000:1.0:1788201054.455496:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0000030400/0x72011f792b78695f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b786958 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.455504:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b0000030400/0x72011f792b78695f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b786958 expref: 16 pid: 5819 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201054.455512:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040679500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5822:1875064622429056:0@lo:104: 00010000:00010000:1.0:1788201054.455535:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b00029c6000/0x72011f792b786935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b78692e expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.455543:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b00029c6000/0x72011f792b786935 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b78692e expref: 16 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201054.455559:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5822:1875064622429184:0@lo:104: 00010000:00010000:1.0:1788201054.455584:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b00126fdc00/0x72011f792b78690b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b786904 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.455592:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b00126fdc00/0x72011f792b78690b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b786904 expref: 16 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201054.455600:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5822:1875064622429312:0@lo:104: 00000100:00100000:1.0:1788201054.455614:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005f6bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201054.456361:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201054.456386:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201054.456415:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201054.456424:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201054.456432:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201054.456443:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622428800 00000100:00100000:3.0:1788201054.456450:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622428800 00000100:00100000:3.0:1788201054.456483:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622428928 00000100:00100000:3.0:1788201054.456485:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622428928 00000100:00100000:3.0:1788201054.456495:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622429056 00000100:00100000:3.0:1788201054.456497:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622429056 00000100:00100000:3.0:1788201054.456504:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622429184 00000100:00100000:3.0:1788201054.456506:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622429184 00000100:00100000:3.0:1788201054.456513:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622429312 00000100:00100000:3.0:1788201054.456515:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622429312 00000100:00100000:3.0:1788201054.456525:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201054.456532:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000568c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+7:5822:x1875064622428800:12345-0@lo:104: 00010000:00010000:3.0:1788201054.456543:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b0001680a00/0x72011f792b78699e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b7869a5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.456609:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201054.456615:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000568c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+7:5822:x1875064622428800:12345-0@lo:104: Request processed in 84us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201054.456622:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201054.456661:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201054.456667:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040904380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+6:5822:x1875064622428928:12345-0@lo:104: 00000100:00100000:0.0:1788201054.456793:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5822:1875064622428800:0@lo:104: 00010000:00010000:3.0:1788201054.456911:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b78697b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.456958:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201054.456964:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040904380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+6:5822:x1875064622428928:12345-0@lo:104: Request processed in 298us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201054.456971:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201054.456985:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201054.456991:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040905880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+5:5822:x1875064622429056:12345-0@lo:104: 00010000:00010000:3.0:1788201054.456998:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b0001681600/0x72011f792b786958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b78695f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457024:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788201054.457029:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040905880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+5:5822:x1875064622429056:12345-0@lo:104: Request processed in 39us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201054.457035:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201054.457046:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201054.457052:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040904700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+4:5822:x1875064622429184:12345-0@lo:104: 00010000:00010000:3.0:1788201054.457059:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b78692e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786935 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457084:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788201054.457088:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040904700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+4:5822:x1875064622429184:12345-0@lo:104: Request processed in 37us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201054.457093:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201054.457104:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201054.457120:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040906300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+3:5822:x1875064622429312:12345-0@lo:104: 00010000:00010000:3.0:1788201054.457155:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b78690b expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457184:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788201054.457189:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040906300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+3:5822:x1875064622429312:12345-0@lo:104: Request processed in 80us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201054.457194:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788201054.457211:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788201054.457217:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0001680a00/0x72011f792b78699e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b7869a5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457224:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680a00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1788201054.457227:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0001680a00/0x72011f792b78699e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b7869a5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457236:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0001680a00/0x72011f792b78699e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b7869a5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201054.457243:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0001680a00/0x72011f792b78699e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b7869a5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201054.457248:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201054.457280:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b0001680a00/0x72011f792b78699e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b7869a5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457287:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201054.457305:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0001680a00/0x72011f792b78699e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b7869a5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457312:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0001680a00/0x72011f792b78699e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b7869a5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457331:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788201054.457334:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b78697b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457340:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000031800 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1788201054.457344:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b78697b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457351:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b78697b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201054.457357:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b78697b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201054.457361:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201054.457374:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786974 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b78697b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457380:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201054.457393:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786974 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b78697b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457399:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786974 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b78697b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457410:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201054.457413:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0001681600/0x72011f792b786958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b78695f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457428:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681600 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1788201054.457431:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0001681600/0x72011f792b786958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b78695f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457437:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0001681600/0x72011f792b786958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b78695f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201054.457444:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0001681600/0x72011f792b786958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b78695f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201054.457449:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201054.457461:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b0001681600/0x72011f792b786958 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b78695f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457467:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201054.457472:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0001681600/0x72011f792b786958 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b78695f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457478:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0001681600/0x72011f792b786958 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b78695f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457488:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201054.457491:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b78692e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786935 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457496:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fd000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1788201054.457499:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b78692e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b786935 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457513:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b78692e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b786935 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201054.457519:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b78692e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b786935 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201054.457524:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201054.457536:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b78692e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786935 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457541:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201054.457546:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b78692e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786935 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457552:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b78692e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786935 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457561:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201054.457564:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b78690b expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457569:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681200 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1788201054.457572:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b78690b expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457579:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b78690b expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201054.457585:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b78690b expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201054.457594:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201054.457605:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786904 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b78690b expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457610:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201054.457613:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786904 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b78690b expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457620:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b78690b expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.457632:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201054.457633:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201054.457635:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201054.457642:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201054.457660:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622429440:0@lo:103: 00000100:00100000:0.0:1788201054.457838:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5822:1875064622428928:0@lo:104: 00000100:00100000:0.0:1788201054.457847:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040679500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5822:1875064622429056:0@lo:104: 00000100:00100000:0.0:1788201054.457853:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5822:1875064622429184:0@lo:104: 00000100:00100000:0.0:1788201054.457859:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5822:1875064622429312:0@lo:104: 00010000:00010000:0.0:1788201054.457884:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0001681400/0x72011f792b7869ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201054.457972:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201054.458036:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622429952:0@lo:103: 00000100:00100000:3.0:1788201054.458055:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201054.459067:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622429440 00000100:00100000:0.0:1788201054.459075:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622429440 00000100:00100000:1.0:1788201054.459105:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622429952 00010000:00010000:0.0:1788201054.459106:0:6691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0001681e00/0x72011f792b7869a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b78699e expref: 17 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201054.459109:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622429952 00010000:00010000:1.0:1788201054.459124:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b00126fdc00/0x72011f792b78690b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786904 expref: 18 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201054.459201:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201054.459210:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040905c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+18:3295:x1875064622429952:12345-0@lo:103: 00010000:00010000:1.0:1788201054.459222:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201054.459228:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b00126fdc00/0x72011f792b78690b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786904 expref: 18 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.459238:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b00126fdc00/0x72011f792b78690b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b786904 expref: 18 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.459253:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00126fdc00/0x72011f792b78690b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b786904 expref: 18 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.459264:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201054.459275:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201054.459284:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622429824:0@lo:103: 00000100:00100000:1.0:1788201054.459297:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040905c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+17:3295:x1875064622429952:12345-0@lo:103: Request processed in 89us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201054.459307:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201054.459313:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201054.459372:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622429952:0@lo:103: 00000100:00100000:3.0:1788201054.459401:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622429568:0@lo:103: 00000100:00100000:3.0:1788201054.459422:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201054.462896:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622429824 00000100:00100000:1.0:1788201054.462911:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622429824 00010000:00010000:1.0:1788201054.462948:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b00029c6000/0x72011f792b786935 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b78692e expref: 17 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201054.462966:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201054.462967:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622429568 00000100:00100000:1.0:1788201054.462969:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622429568 00010000:00010000:1.0:1788201054.462980:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b00029c7e00/0x72011f792b78697b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786974 expref: 18 pid: 5821 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201054.462989:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622429696:0@lo:103: 00000100:00100000:1.0:1788201054.462993:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201054.463000:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040905f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+18:3295:x1875064622429440:12345-0@lo:103: 00010000:00010000:1.0:1788201054.463012:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201054.463017:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0001681e00/0x72011f792b7869a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b78699e expref: 18 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.463028:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0001681e00/0x72011f792b7869a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b78699e expref: 18 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201054.463036:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201054.463045:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0001681e00/0x72011f792b7869a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b78699e expref: 18 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.463059:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201054.463090:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622429696 00000100:00100000:2.0:1788201054.463094:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622429696 00000100:00100000:1.0:1788201054.463103:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040905f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+18:3295:x1875064622429440:12345-0@lo:103: Request processed in 103us (5132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201054.463110:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201054.463126:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788201054.463147:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040904000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+17:3295:x1875064622429824:12345-0@lo:103: 00010000:00010000:1.0:1788201054.463164:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201054.463169:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b00029c6000/0x72011f792b786935 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b78692e expref: 17 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.463177:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b00029c6000/0x72011f792b786935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b78692e expref: 17 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.463187:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00029c6000/0x72011f792b786935 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b78692e expref: 17 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.463198:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201054.463221:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040904000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+16:3295:x1875064622429824:12345-0@lo:103: Request processed in 89us (3913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201054.463227:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788201054.463239:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201054.463244:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040906680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+15:3292:x1875064622429568:12345-0@lo:103: 00010000:00010000:1.0:1788201054.463252:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201054.463256:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b00029c7e00/0x72011f792b78697b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786974 expref: 15 pid: 5821 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201054.463264:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622429824:0@lo:103: 00010000:00010000:1.0:1788201054.463264:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b00029c7e00/0x72011f792b78697b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b786974 expref: 15 pid: 5821 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201054.463273:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622429440:0@lo:103: 00010000:00010000:1.0:1788201054.463274:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00029c7e00/0x72011f792b78697b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b786974 expref: 15 pid: 5821 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.463281:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201054.463308:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040906680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+14:3292:x1875064622429568:12345-0@lo:103: Request processed in 64us (3886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201054.463313:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622429568:0@lo:103: 00000100:00100000:1.0:1788201054.463315:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1788201054.467003:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0000030400/0x72011f792b78695f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786958 expref: 13 pid: 5819 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201054.467050:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201054.467070:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040904a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+13:3292:x1875064622429696:12345-0@lo:103: 00010000:00010000:2.0:1788201054.467089:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201054.467096:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0000030400/0x72011f792b78695f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786958 expref: 13 pid: 5819 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201054.467276:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0000030400/0x72011f792b78695f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b786958 expref: 13 pid: 5819 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201054.467296:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0000030400/0x72011f792b78695f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b786958 expref: 13 pid: 5819 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201054.467315:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0001681400/0x72011f792b7869ba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201054.467325:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0001681400/0x72011f792b7869ba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201054.467341:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0001681400/0x72011f792b7869ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201054.467348:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0001681400/0x72011f792b7869ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201054.467372:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0001681400/0x72011f792b7869ba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201054.467379:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0001681400/0x72011f792b7869ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201054.467386:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681400 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:2.0:1788201054.467390:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0001681400/0x72011f792b7869ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201054.467398:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0001681400/0x72011f792b7869ba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.467558:0:5822:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0001681400/0x72011f792b7869ba lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.467567:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0001681400/0x72011f792b7869ba lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201054.467575:0:5822:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1788201054.467644:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0001681400/0x72011f792b7869ba lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201054.467652:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0001681400/0x72011f792b7869ba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201054.467667:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201054.467755:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040904a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+12:3292:x1875064622429696:12345-0@lo:103: Request processed in 688us (4708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201054.467762:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788201054.467901:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622429696:0@lo:103: 00000100:00100000:0.0:1788201054.514971:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000506a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+11:7624:x1875064622428672:12345-0@lo:253: Request processed in 86984us (87438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201054.514986:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788201054.515098:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622428672:0@lo:253: 10000000:01000000:2.0:1788201054.515122:0:7624:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788201054.515125:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201054.515127:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201054.515128:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201054.515129:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788201054.515130:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201054.515173:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201054.515174:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201054.515176:0:7624:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788201054.515177:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201054.515179:0:7624:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788201054.515198:0:7624:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b003f8e9800 from lustre-OST0001 10000000:01000000:2.0:1788201054.515225:0:7624:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788201054.515228:0:7624:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788201054.515235:0:7624:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b000701cd40 local copy 10000000:01000000:2.0:1788201054.515239:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788201054.515272:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00029c6600/0x72011f792b7869c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201054.515284:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.114@tcp lock: ffff9b00029c6600/0x72011f792b7869c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201054.515293:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b00029c6600/0x72011f792b7869c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201054.515309:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622430080:0@lo:101: 00000100:00100000:2.0:1788201054.515343:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201054.515370:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201054.515489:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622430080 00000100:00100000:0.0:1788201054.515495:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622430080 00000100:00100000:0.0:1788201054.515540:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788201054.515549:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005069850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+11:7624:x1875064622430080:12345-0@lo:101: 00010000:00010000:0.0:1788201054.515561:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201054.515573:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0000030a00/0x72011f792b7869c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b7869c1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.515596:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0000030a00/0x72011f792b7869c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b7869c1 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.515606:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0000030a00/0x72011f792b7869c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b7869c1 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.515615:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000030a00, rc 0) 00000100:00100000:0.0:1788201054.515655:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005069850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+12:7624:x1875064622430080:12345-0@lo:101: Request processed in 107us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201054.515671:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788201054.515744:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622430080:0@lo:101: 00010000:00010000:2.0:1788201054.515765:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b00029c6600/0x72011f792b7869c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x72011f792b7869c8 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201054.515773:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b00029c6600/0x72011f792b7869c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72011f792b7869c8 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201054.515868:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622430208:0@lo:501: 00000100:00100000:2.0:1788201054.515893:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201054.515922:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201054.515973:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622430208 00000100:00100000:0.0:1788201054.515977:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622430208 00000100:00100000:0.0:1788201054.516004:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788201054.516011:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+12:7624:x1875064622430208:12345-0@lo:501: 00000100:00100000:0.0:1788201054.516235:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+12:7624:x1875064622430208:12345-0@lo:501: Request processed in 224us (340us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201054.516242:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788201054.516268:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622430208:0@lo:501: 10000000:01000000:0.0:1788201054.516280:0:7624:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788201054.516306:0:7624:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788201054.516312:0:7624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00029c6600/0x72011f792b7869c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72011f792b7869c8 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.516320:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00029c6600/0x72011f792b7869c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72011f792b7869c8 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.516327:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff9b00029c6600/0x72011f792b7869c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72011f792b7869c8 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.516344:0:7624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788201054.516360:0:7624:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b003f8e9800 10000000:01000000:0.0:1788201054.516365:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788201054.516369:0:7624:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788201054.516371:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201054.516375:0:7624:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788201054.516378:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788201054.516399:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b7869cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.516406:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b7869cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.516414:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b7869cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201054.516426:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622430336:0@lo:101: 00000100:00100000:0.0:1788201054.516450:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201054.516467:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201054.516485:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622430336 00000100:00100000:0.0:1788201054.516489:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622430336 00000100:00100000:0.0:1788201054.516506:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788201054.516511:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+12:7624:x1875064622430336:12345-0@lo:101: 00010000:00010000:0.0:1788201054.516517:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201054.516526:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0000030800/0x72011f792b7869d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b7869cf expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.516540:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0000030800/0x72011f792b7869d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b7869cf expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.516548:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0000030800/0x72011f792b7869d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b7869cf expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.516555:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000030800, rc 0) 00000100:00100000:0.0:1788201054.516580:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:7624:x1875064622430336:12345-0@lo:101: Request processed in 69us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201054.516585:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788201054.516612:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622430336:0@lo:101: 00010000:00010000:0.0:1788201054.516622:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b7869cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7869d6 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.516629:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b7869cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b7869d6 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201054.516675:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622430464:0@lo:501: 00000100:00100000:0.0:1788201054.516698:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201054.516707:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201054.516723:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622430464 00000100:00100000:0.0:1788201054.516727:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622430464 00000100:00100000:0.0:1788201054.516741:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788201054.516760:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:7624:x1875064622430464:12345-0@lo:501: 00000100:00100000:0.0:1788201054.516897:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:7624:x1875064622430464:12345-0@lo:501: Request processed in 150us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201054.516905:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788201054.516926:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622430464:0@lo:501: 00000100:00100000:0.0:1788201054.516950:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622430592:0@lo:503: 00000100:00100000:0.0:1788201054.516985:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201054.516994:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201054.517010:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622430592 00000100:00100000:0.0:1788201054.517014:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622430592 00000100:00100000:0.0:1788201054.517030:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201054.517036:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:7624:x1875064622430592:12345-0@lo:503: 00000100:00100000:0.0:1788201054.517198:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:7624:x1875064622430592:12345-0@lo:503: Request processed in 162us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201054.517213:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201054.517252:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622430592:0@lo:503: 00000040:00080000:0.0:1788201054.517515:0:7624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201054.517565:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622430720:0@lo:502: 00000100:00100000:0.0:1788201054.517609:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201054.517627:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6bb40 going to sleep for 11 seconds 00010000:00010000:3.0:1788201054.517640:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788201054.517644:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622430720 00010000:00010000:3.0:1788201054.517647:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b00029c6600/0x72011f792b7869c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x72011f792b7869c8 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201054.517647:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622430720 00010000:00010000:3.0:1788201054.517655:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6600 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1788201054.517659:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b00029c6600/0x72011f792b7869c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x72011f792b7869c8 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201054.517663:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00010000:00010000:3.0:1788201054.517668:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b00029c6600/0x72011f792b7869c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x72011f792b7869c8 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201054.517669:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:7624:x1875064622430720:12345-0@lo:502: 10000000:00010000:3.0:1788201054.517776:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b00029c6600/0x72011f792b7869c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x72011f792b7869c8 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201054.517783:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201054.517804:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b00029c6600/0x72011f792b7869c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x72011f792b7869c8 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201054.517804:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:7624:x1875064622430720:12345-0@lo:502: Request processed in 134us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201054.517810:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:3.0:1788201054.517811:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201054.517842:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622430720:0@lo:502: 00010000:00010000:3.0:1788201054.517899:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b00029c6600/0x72011f792b7869c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x72011f792b7869c8 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.517907:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b00029c6600/0x72011f792b7869c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x72011f792b7869c8 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.517930:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201054.517932:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201054.517934:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201054.517942:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201054.517951:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622430848:0@lo:103: 00000100:00100000:3.0:1788201054.517980:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788201054.518050:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788201054.518103:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788201054.518160:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788201054.518209:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788201054.518243:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788201054.518276:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788201054.518296:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622430976:0@lo:502: 00000100:00100000:0.0:1788201054.518331:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201054.518346:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201054.518367:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622430848 00000100:00100000:0.0:1788201054.518371:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622430848 00000100:00100000:0.0:1788201054.518398:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201054.518404:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040907b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16f590af-689d-4459-b486-809c9db65822+13:3293:x1875064622430848:12345-0@lo:103: 00010000:00010000:0.0:1788201054.518418:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201054.518430:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0000030a00/0x72011f792b7869c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72011f792b7869c1 expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.518441:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201054.518466:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040907b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16f590af-689d-4459-b486-809c9db65822+12:3293:x1875064622430848:12345-0@lo:103: Request processed in 62us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201054.518472:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201054.518494:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622430848:0@lo:103: 00000100:00100000:0.0:1788201054.518517:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622430976 00000100:00100000:0.0:1788201054.518519:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622430976 00000100:00100000:0.0:1788201054.518532:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788201054.518537:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+12:7624:x1875064622430976:12345-0@lo:502: 00000100:00100000:0.0:1788201054.518646:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+12:7624:x1875064622430976:12345-0@lo:502: Request processed in 108us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201054.518652:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788201054.518678:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622430976:0@lo:502: 00000040:00080000:0.0:1788201054.518757:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788201054.518767:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788201054.519942:0:7632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201054.519951:0:7632:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788201054.519957:0:7632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201054.519960:0:7632:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788201054.519967:0:7632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201054.519980:0:7632:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b0040938000) 00000020:00000080:3.0:1788201054.520004:0:7632:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788201054.520009:0:7632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788201054.520092:0:7632:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b003f8e9800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788201054.520100:0:7632:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788201054.520107:0:7632:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72011f792b7869e4 00010000:00010000:3.0:1788201054.524651:0:7632:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788201054.524945:0:7632:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788201054.529457:0:7632:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788201054.529719:0:7632:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788201054.534105:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788201054.535291:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788201054.536561:0:7632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788201054.536570:0:7632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201054.536575:0:7632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201054.536577:0:7632:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788201054.536581:0:7632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201054.536583:0:7632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201054.536585:0:7632:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788201054.536587:0:7632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788201054.536594:0:7632:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788201054.536639:0:7632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201054.536642:0:7632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201054.536643:0:7632:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788201054.536646:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788201054.536788:0:7624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788201054.536819:0:7624:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788201054.536836:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b7869cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7869d6 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.536847:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b7869cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7869d6 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201054.536855:0:7624:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b003f8e9800 from 1 10000000:01000000:1.0:1788201054.536858:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201054.536894:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681e00/0x72011f792b7869eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.536902:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0001681e00/0x72011f792b7869eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.536914:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0001681e00/0x72011f792b7869eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201054.536936:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622431104:0@lo:101: 00000100:00100000:1.0:1788201054.536999:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201054.537045:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005f6b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201054.537119:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622431104 00000100:00100000:0.0:1788201054.537126:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622431104 00000100:00100000:0.0:1788201054.537192:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788201054.537202:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+12:7624:x1875064622431104:12345-0@lo:101: 00010000:00010000:0.0:1788201054.537215:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201054.537227:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0000030a00/0x72011f792b7869f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b7869eb expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.537249:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0000030a00/0x72011f792b7869f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b7869eb expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.537260:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0000030a00/0x72011f792b7869f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b7869eb expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.537268:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000030a00, rc 0) 00000100:00100000:0.0:1788201054.537307:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:7624:x1875064622431104:12345-0@lo:101: Request processed in 106us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201054.537313:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788201054.537458:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622431104:0@lo:101: 00010000:00010000:1.0:1788201054.537471:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0001681e00/0x72011f792b7869eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7869f2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.537479:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0001681e00/0x72011f792b7869eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b7869f2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201054.537561:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622431232:0@lo:501: 00000100:00100000:1.0:1788201054.537597:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201054.537627:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005f6b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201054.537844:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622431232 00000100:00100000:0.0:1788201054.537849:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622431232 00000100:00100000:0.0:1788201054.537880:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788201054.537888:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+13:7624:x1875064622431232:12345-0@lo:501: 00000100:00100000:0.0:1788201054.538166:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+13:7624:x1875064622431232:12345-0@lo:501: Request processed in 279us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201054.538173:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788201054.538362:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622431232:0@lo:501: 00000100:00100000:2.0:1788201054.538392:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622431360:0@lo:503: 00000100:00100000:2.0:1788201054.538429:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201054.538492:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201054.538532:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622431360 00000100:00100000:1.0:1788201054.538537:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622431360 00000100:00100000:1.0:1788201054.538592:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788201054.538599:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+13:7624:x1875064622431360:12345-0@lo:503: 00000100:00100000:1.0:1788201054.538897:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+13:7624:x1875064622431360:12345-0@lo:503: Request processed in 298us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201054.538905:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788201054.538973:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622431360:0@lo:503: 00000040:00080000:2.0:1788201054.539239:0:7624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788201054.539293:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622431488:0@lo:502: 00000100:00100000:2.0:1788201054.539330:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201054.539523:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201054.539562:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622431488 00000100:00100000:0.0:1788201054.539567:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622431488 00000100:00100000:0.0:1788201054.539592:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788201054.539598:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+13:7624:x1875064622431488:12345-0@lo:502: 00000100:00100000:0.0:1788201054.539807:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+13:7624:x1875064622431488:12345-0@lo:502: Request processed in 207us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201054.539814:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788201054.539912:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622431488:0@lo:502: 00000040:00080000:2.0:1788201054.540469:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788201054.540521:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788201054.540547:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622431616:0@lo:502: 00000100:00100000:2.0:1788201054.540595:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201054.540675:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201054.540739:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622431616 00000100:00100000:0.0:1788201054.540744:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622431616 00000100:00100000:0.0:1788201054.540791:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788201054.540798:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+13:7624:x1875064622431616:12345-0@lo:502: 00000100:00100000:0.0:1788201054.541198:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+13:7624:x1875064622431616:12345-0@lo:502: Request processed in 399us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201054.541205:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788201054.541265:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622431616:0@lo:502: 00000040:00080000:2.0:1788201054.541346:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788201054.541355:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788201054.541769:0:7636:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201054.541778:0:7636:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201054.541780:0:7636:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788201054.541788:0:7636:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b003f8e9800 00000020:00000080:3.0:1788201054.541790:0:7636:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201054.541809:0:7636:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201054.541812:0:7636:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201054.541813:0:7636:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788201054.541821:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788201054.542409:0:7624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788201054.542428:0:7624:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201054.542452:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681e00/0x72011f792b7869eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7869f2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.542461:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0001681e00/0x72011f792b7869eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b7869f2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201054.542498:0:7624:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788201054.542501:0:7624:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b003f8e9800 10000000:01000000:3.0:1788201054.542504:0:7624:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b003f8e9800 10000000:01000000:3.0:1788201054.542508:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201054.542514:0:7624:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b003f8e9800 from 1 10000000:01000000:3.0:1788201054.542516:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201054.542545:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b7869f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.542553:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b7869f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.542563:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b7869f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201054.542580:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040904e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622431744:0@lo:101: 00000100:00100000:3.0:1788201054.542624:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201054.542650:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622431744 00000100:00100000:3.0:1788201054.542656:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8e4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201054.542656:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622431744 00000100:00100000:1.0:1788201054.542687:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201054.542694:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:7624:x1875064622431744:12345-0@lo:101: 00010000:00010000:1.0:1788201054.542706:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201054.542718:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0001681400/0x72011f792b786a00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b7869f9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.542739:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0001681400/0x72011f792b786a00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b7869f9 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.542797:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0001681400/0x72011f792b786a00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b7869f9 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.542804:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681400, rc 0) 00000100:00100000:1.0:1788201054.542883:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+14:7624:x1875064622431744:12345-0@lo:101: Request processed in 187us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201054.542889:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788201054.542994:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040904e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622431744:0@lo:101: 00010000:00010000:3.0:1788201054.543006:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b7869f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a00 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.543023:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b7869f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786a00 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201054.543097:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040904e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622431872:0@lo:501: 00000100:00100000:3.0:1788201054.543118:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201054.543170:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8e4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201054.543261:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622431872 00000100:00100000:0.0:1788201054.543265:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622431872 00000100:00100000:0.0:1788201054.543295:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788201054.543302:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+14:7624:x1875064622431872:12345-0@lo:501: 00000100:00100000:0.0:1788201054.543522:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+14:7624:x1875064622431872:12345-0@lo:501: Request processed in 219us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201054.543529:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788201054.543577:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040904e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622431872:0@lo:501: 00000100:00100000:3.0:1788201054.543600:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040904e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622432000:0@lo:503: 00000100:00100000:3.0:1788201054.543631:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201054.543652:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8e4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201054.543712:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622432000 00000100:00100000:2.0:1788201054.543717:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622432000 00000100:00100000:2.0:1788201054.543760:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788201054.543767:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+14:7624:x1875064622432000:12345-0@lo:503: 00000100:00100000:2.0:1788201054.544076:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+14:7624:x1875064622432000:12345-0@lo:503: Request processed in 308us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201054.544083:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788201054.544236:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040904e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622432000:0@lo:503: 00000040:00080000:3.0:1788201054.544480:0:7624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201054.544535:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040904e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622432128:0@lo:502: 00000100:00100000:3.0:1788201054.544570:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201054.544726:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8e4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201054.544784:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622432128 00000100:00100000:0.0:1788201054.544790:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622432128 00000100:00100000:0.0:1788201054.544825:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788201054.544833:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+14:7624:x1875064622432128:12345-0@lo:502: 00000100:00100000:0.0:1788201054.545026:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+14:7624:x1875064622432128:12345-0@lo:502: Request processed in 193us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201054.545043:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788201054.545309:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040904e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622432128:0@lo:502: 00000040:00080000:2.0:1788201054.545578:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788201054.545631:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788201054.545665:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788201054.545712:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788201054.545769:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788201054.545831:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788201054.545870:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788201054.545903:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788201054.545961:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788201054.546002:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788201054.546035:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788201054.546097:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788201054.546374:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788201054.546411:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788201054.546459:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788201054.546495:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788201054.546527:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788201054.546573:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788201054.546610:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788201054.546644:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788201054.546701:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788201054.546739:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788201054.546789:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788201054.546838:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788201054.546875:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788201054.546910:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788201054.546958:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788201054.547011:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788201054.547050:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788201054.547099:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1788201054.547495:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1788201054.547535:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1788201054.547568:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1788201054.547616:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1788201054.547653:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1788201054.547696:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1788201054.547731:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1788201054.547783:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622432256:0@lo:502: 00000100:00100000:0.0:1788201054.547849:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201054.547921:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201054.547961:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622432256 00000100:00100000:2.0:1788201054.547975:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622432256 00000100:00100000:2.0:1788201054.548056:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788201054.548065:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+14:7624:x1875064622432256:12345-0@lo:502: 00000100:00100000:2.0:1788201054.548310:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+14:7624:x1875064622432256:12345-0@lo:502: Request processed in 245us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201054.548317:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201054.548401:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622432256:0@lo:502: 00000040:00080000:3.0:1788201054.548473:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788201054.548483:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788201054.548901:0:7637:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788201054.548921:0:7637:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b0010a4b380) 00000020:00000080:1.0:1788201054.548940:0:7637:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788201054.550537:0:7637:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b003f8e9800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788201054.550544:0:7637:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b003f8e9800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788201054.550547:0:7637:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b003f8e9800 3 00010000:00080000:1.0:1788201054.550578:0:7637:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b004073d000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.114@tcp at head 00010000:00010000:1.0:1788201054.554663:0:7637:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788201054.554770:0:7637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788201054.554808:0:7637:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201054.554832:0:7637:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x72011f792b786a0e 00000100:00080000:1.0:1788201054.554842:0:7637:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201054.554848:0:7637:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b004073d000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788201054.554883:0:7637:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b0040678380 x1875064622432384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201054.554920:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1875064622432384:0@lo:38: 00000100:00100000:1.0:1788201054.554986:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201054.555043:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622432384 00000100:00100000:1.0:1788201054.555049:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622432384 00000100:00100000:1.0:1788201054.555081:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201054.555088:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1875064622432384:12345-0@lo:38: 00010000:00080000:1.0:1788201054.555109:0:5827:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 133 last 0 00000020:00000080:1.0:1788201054.555157:0:5827:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x72011f792b786a15 00000004:00100000:1.0:1788201054.555172:0:5827:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201054.555201:0:5827:0:(import.c:65:import_set_state_nolock()) ffff9b0035c0a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201054.555250:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875064622432384:12345-0@lo:38: Request processed in 161us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201054.555257:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788201054.555293:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b0040678380 x1875064622432384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201054.555310:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201054.555318:0:3291:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788201054.555326:0:3291:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788201054.555330:0:3291:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788201054.555332:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b004073d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788201054.555337:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1875064622432384:0@lo:38: 00000100:00080000:1.0:1788201054.555354:0:7637:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788201054.555690:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622432640:0@lo:400: 00000100:00100000:3.0:1788201054.555733:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201054.555767:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201054.555773:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622432768:0@lo:400: 00000100:00100000:3.0:1788201054.555797:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201054.555826:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622432640 00000100:00100000:3.0:1788201054.555839:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622432640 00000100:00100000:3.0:1788201054.555879:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201054.555888:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622432640:12345-0@lo:400: 00000100:00100000:3.0:1788201054.555927:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622432640:12345-0@lo:400: Request processed in 41us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201054.555933:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788201054.555948:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788201054.555967:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b0040906a00 x1875064622432640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201054.555978:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622432640:0@lo:400: 00000040:00080000:1.0:1788201054.558011:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788201054.558052:0:7624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788201054.558079:0:7624:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201054.558098:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b7869f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a00 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.558107:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b7869f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a00 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201054.558251:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622432512:0@lo:400: 00000100:00100000:0.0:1788201054.558310:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201054.558362:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622432768 00000100:00100000:0.0:1788201054.558369:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622432768 00000100:00100000:0.0:1788201054.558414:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201054.558422:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622432768:12345-0@lo:400: 00000100:00100000:0.0:1788201054.558474:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622432768:12345-0@lo:400: Request processed in 53us (2675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201054.558481:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201054.558498:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622432512 00000100:00100000:0.0:1788201054.558501:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622432512 00000100:00100000:0.0:1788201054.558522:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201054.558528:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622432512:12345-0@lo:400: 00000100:00100000:0.0:1788201054.558561:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622432512:12345-0@lo:400: Request processed in 33us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201054.558567:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788201054.558593:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788201054.558625:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b0040906d80 x1875064622432768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201054.558637:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622432768:0@lo:400: 00010000:00080000:0.0:1788201054.558665:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b0040904e00 x1875064622432512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201054.558673:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622432512:0@lo:400: 00000020:01000004:1.0:1788201054.558909:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788201054.558911:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788201054.558912:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201054.558913:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201054.558914:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201054.558916:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201054.558918:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201054.558919:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788201054.558921:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788201054.558922:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201054.558924:0:7624:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201054.558927:0:7624:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788201054.558929:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201054.558931:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788201054.558936:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201054.558937:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201054.558938:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201054.558939:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201054.558940:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201054.558940:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788201054.558941:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788201054.558942:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201054.558943:0:7624:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201054.558961:0:7624:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788201054.558972:0:7624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622432896:0@lo:253: 00000100:00100000:1.0:1788201054.559008:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201054.559150:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c07800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7639:1875064622433024:0@lo:901: 00000100:00100000:3.0:1788201054.559185:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201054.559215:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622433024 00000100:00100000:3.0:1788201054.559218:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622433024 00000100:00100000:3.0:1788201054.559253:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201054.559261:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7639:x1875064622433024:12345-0@lo:901: 00000100:00100000:3.0:1788201054.559600:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7639:x1875064622433024:12345-0@lo:901: Request processed in 340us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201054.559607:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201054.559625:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8e4900 going to sleep for 11 seconds 00010000:00080000:3.0:1788201054.559638:0:7639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b0035c07800 x1875064622433024/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788201070 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201054.559648:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c07800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7639:1875064622433024:0@lo:901: 00000100:00100000:1.0:1788201054.559779:0:7624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005f6b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201054.559943:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622432896 00000100:00100000:2.0:1788201054.559948:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622432896 00000100:00100000:2.0:1788201054.559985:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788201054.559992:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+14:7624:x1875064622432896:12345-0@lo:253: 20000000:01000000:2.0:1788201054.560012:0:5821:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788201054.560023:0:5821:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1788201054.560210:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:2.0:1788201054.578840:0:5821:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201054.578860:0:5821:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788201054.578917:0:5843:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201054.578922:0:5843:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201054.578943:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0001681200/0x72011f792b786a1c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.578961:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0001680e00/0x72011f792b78696d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786966 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.578969:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0001681200/0x72011f792b786a1c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.579008:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0001680e00/0x72011f792b78696d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b786966 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201054.579021:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b0001680e00/0x72011f792b78696d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b786966 expref: 14 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201054.579035:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5843:1875064622433152:0@lo:104: 00000100:00100000:1.0:1788201054.579089:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201054.579159:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005f6b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201054.579302:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622433152 00000100:00100000:2.0:1788201054.579309:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622433152 00000100:00100000:2.0:1788201054.579360:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201054.579369:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+3:5843:x1875064622433152:12345-0@lo:104: 00010000:00010000:2.0:1788201054.579381:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b786966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b78696d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201054.579429:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201054.579435:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+3:5843:x1875064622433152:12345-0@lo:104: Request processed in 68us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201054.579442:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201054.579517:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5843:1875064622433152:0@lo:104: 00010000:00010000:1.0:1788201054.579534:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0001681200/0x72011f792b786a1c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.579706:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201054.579712:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b786966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b78696d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.579732:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030c00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1788201054.579736:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b786966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b78696d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.579744:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b786966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b78696d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201054.579761:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b786966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b78696d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201054.579768:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201054.579803:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b786966 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b78696d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.579810:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201054.579827:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b786966 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b78696d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.579834:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b786966 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b78696d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.579850:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201054.579852:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201054.579853:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201054.579864:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622433280:0@lo:103: 00000100:00100000:3.0:1788201054.579897:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201054.579938:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622433280 00000100:00100000:3.0:1788201054.579943:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622433280 00010000:00010000:3.0:1788201054.579961:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0001680e00/0x72011f792b78696d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786966 expref: 15 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201054.579992:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788201054.579999:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000679b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+15:3292:x1875064622433280:12345-0@lo:103: 00010000:00010000:3.0:1788201054.580009:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201054.580014:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0001680e00/0x72011f792b78696d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786966 expref: 15 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.580024:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0001680e00/0x72011f792b78696d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b786966 expref: 15 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.580036:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0001680e00/0x72011f792b78696d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b786966 expref: 15 pid: 5822 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.580048:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0001681200/0x72011f792b786a1c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.580055:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0001681200/0x72011f792b786a1c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201054.580066:0:5814:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001460606s 00010000:00010000:3.0:1788201054.580070:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0001681200/0x72011f792b786a1c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.580077:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0001681200/0x72011f792b786a1c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.580083:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0001681200/0x72011f792b786a1c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.580090:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0001681200/0x72011f792b786a1c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.580100:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681200 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201054.580104:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0001681200/0x72011f792b786a1c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.580294:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0001681200/0x72011f792b786a1c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.580314:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0001681200/0x72011f792b786a1c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201054.580323:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201054.580399:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000679b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+14:3292:x1875064622433280:12345-0@lo:103: Request processed in 400us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201054.580406:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788201054.580488:0:5843:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0001681200/0x72011f792b786a1c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.580496:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0001681200/0x72011f792b786a1c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201054.580502:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0001681200/0x72011f792b786a1c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201054.581121:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622433280:0@lo:103: 00000100:00100000:2.0:1788201054.588408:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+13:7624:x1875064622432896:12345-0@lo:253: Request processed in 28407us (29390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201054.588435:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788201054.588512:0:7624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16f590af-689d-4459-b486-809c9db65822:7624:1875064622432896:0@lo:253: 10000000:01000000:1.0:1788201054.588525:0:7624:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788201054.588528:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201054.588530:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788201054.588532:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201054.588533:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201054.588534:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201054.588535:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201054.588537:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201054.588539:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788201054.588540:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788201054.588541:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201054.588542:0:7624:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788201054.588554:0:7624:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788201054.596850:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201054.597051:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788201054.597419:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201054.597591:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788201054.597801:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201054.598049:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788201054.599498:0:7624:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1788201054.674178:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788201054.812279:0:7624:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788201054.812286:0:7624:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788201054.812314:0:7624:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788201054.812446:0:7624:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.114@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788201054.812463:0:7624:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788201054.812487:0:7624:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788201055.691650:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788201056.652770:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788201056.652777:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b0010346000 from 30 10000000:01000000:1.0:1788201056.652781:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201056.652825:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786a23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201056.652837:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786a23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201056.652856:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786a23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201056.652884:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622433408:0@lo:101: 00000100:00100000:1.0:1788201056.652946:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201056.652993:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201056.653164:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622433408 00000100:00100000:3.0:1788201056.653172:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622433408 00000100:00100000:3.0:1788201056.653229:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788201056.653240:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+13:5825:x1875064622433408:12345-0@lo:101: 00010000:00010000:3.0:1788201056.653254:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201056.653268:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b00126fd200/0x72011f792b786a2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786a23 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201056.653294:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00126fd200/0x72011f792b786a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786a23 expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201056.653305:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b00126fd200/0x72011f792b786a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786a23 expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201056.653315:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fd200, rc 0) 00000100:00100000:3.0:1788201056.653366:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+14:5825:x1875064622433408:12345-0@lo:101: Request processed in 128us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201056.653373:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788201056.653837:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622433408:0@lo:101: 00010000:00010000:1.0:1788201056.653851:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786a23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a2a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201056.653861:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786a23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786a2a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201056.653910:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622433536:0@lo:501: 00000100:00100000:1.0:1788201056.653936:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201056.653963:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201056.654155:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622433536 00000100:00100000:2.0:1788201056.654161:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622433536 00000100:00100000:2.0:1788201056.654191:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788201056.654199:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+14:5825:x1875064622433536:12345-0@lo:501: 00000100:00100000:2.0:1788201056.654599:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+14:5825:x1875064622433536:12345-0@lo:501: Request processed in 320us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201056.654608:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788201056.655434:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622433536:0@lo:501: 00000100:00100000:1.0:1788201056.655469:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622433664:0@lo:503: 00000100:00100000:1.0:1788201056.655513:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201056.655549:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201056.655553:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622433664 00000100:00100000:3.0:1788201056.655558:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622433664 00000100:00100000:3.0:1788201056.655595:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788201056.655604:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+14:5825:x1875064622433664:12345-0@lo:503: 00000100:00100000:3.0:1788201056.655928:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+14:5825:x1875064622433664:12345-0@lo:503: Request processed in 324us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201056.655936:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788201056.656917:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622433664:0@lo:503: 00000100:00100000:2.0:1788201056.658686:0:7759:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005137100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7759:1875064622433792:0@lo:502: 00000100:00100000:2.0:1788201056.658777:0:7759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201056.658824:0:7759:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8c1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201056.658877:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622433792 00000100:00100000:3.0:1788201056.658884:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622433792 00000100:00100000:3.0:1788201056.658933:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788201056.658943:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+14:7759:x1875064622433792:12345-0@lo:502: 00000100:00100000:3.0:1788201056.659280:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+14:7759:x1875064622433792:12345-0@lo:502: Request processed in 338us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201056.659287:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788201056.659942:0:7759:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005137100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7759:1875064622433792:0@lo:502: 00000100:00100000:1.0:1788201056.659996:0:7759:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7759:1875064622433920:0@lo:502: 00000100:00100000:1.0:1788201056.660033:0:7759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201056.660068:0:7759:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201056.660215:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622433920 00000100:00100000:2.0:1788201056.660221:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622433920 00000100:00100000:2.0:1788201056.660260:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788201056.660268:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+14:7759:x1875064622433920:12345-0@lo:502: 00000100:00100000:2.0:1788201056.660435:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+14:7759:x1875064622433920:12345-0@lo:502: Request processed in 167us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201056.660443:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788201056.661637:0:7759:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7759:1875064622433920:0@lo:502: 00000040:00080000:1.0:1788201056.661669:0:7759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788201056.661759:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788201056.661777:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201056.661786:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786a23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a2a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.661811:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a2a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201056.661821:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788201056.661823:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788201056.661826:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201056.661854:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00029c6000/0x72011f792b786a31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.661862:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b00029c6000/0x72011f792b786a31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.661871:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b00029c6000/0x72011f792b786a31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201056.661886:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005137480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622434048:0@lo:101: 00000100:00100000:2.0:1788201056.661926:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201056.661965:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8c1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201056.662021:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622434048 00000100:00100000:3.0:1788201056.662027:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622434048 00000100:00100000:3.0:1788201056.662068:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788201056.662077:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+14:5825:x1875064622434048:12345-0@lo:101: 00010000:00010000:3.0:1788201056.662088:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201056.662109:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b00126fda00/0x72011f792b786a38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786a31 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201056.662152:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00126fda00/0x72011f792b786a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786a31 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201056.662177:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b00126fda00/0x72011f792b786a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786a31 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201056.662185:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fda00, rc 0) 00000100:00100000:3.0:1788201056.662224:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+15:5825:x1875064622434048:12345-0@lo:101: Request processed in 148us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201056.662230:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788201056.662864:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005137480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622434048:0@lo:101: 00010000:00010000:1.0:1788201056.662878:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b00029c6000/0x72011f792b786a31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a38 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201056.662887:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b00029c6000/0x72011f792b786a31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786a38 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201056.662932:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622434176:0@lo:501: 00000100:00100000:1.0:1788201056.662960:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201056.662985:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201056.663608:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622434176 00000100:00100000:3.0:1788201056.663615:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622434176 00000100:00100000:3.0:1788201056.663654:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788201056.663661:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+15:5825:x1875064622434176:12345-0@lo:501: 00000100:00100000:2.0:1788201056.663954:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622434176:0@lo:501: 00000100:00100000:2.0:1788201056.663988:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005137800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622434304:0@lo:503: 00000100:00100000:3.0:1788201056.665377:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+15:5825:x1875064622434176:12345-0@lo:501: Request processed in 1700us (2400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201056.665389:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788201056.666974:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201056.667030:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8c1000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201056.667590:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622434304 00000100:00100000:1.0:1788201056.667598:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622434304 00000100:00100000:1.0:1788201056.667647:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788201056.667656:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+15:5825:x1875064622434304:12345-0@lo:503: 00000100:00100000:1.0:1788201056.668031:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+15:5825:x1875064622434304:12345-0@lo:503: Request processed in 375us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201056.668039:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788201056.668244:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005137800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622434304:0@lo:503: 00000100:00100000:0.0:1788201056.668712:0:7760:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7760:1875064622434432:0@lo:502: 00000100:00100000:0.0:1788201056.668773:0:7760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201056.668817:0:7760:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0033212780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201056.668950:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622434432 00000100:00100000:2.0:1788201056.668956:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622434432 00000100:00100000:2.0:1788201056.668993:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788201056.669001:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+15:7760:x1875064622434432:12345-0@lo:502: 00000100:00100000:2.0:1788201056.669400:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+15:7760:x1875064622434432:12345-0@lo:502: Request processed in 397us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201056.669407:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788201056.669472:0:7760:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7760:1875064622434432:0@lo:502: 00000020:01000000:0.0:1788201056.669501:0:7760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201056.669510:0:7760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201056.669512:0:7760:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788201056.669526:0:7760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788201056.669529:0:7760:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788201056.669548:0:7760:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7760:1875064622434560:0@lo:502: 00000100:00100000:0.0:1788201056.669588:0:7760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201056.669651:0:7760:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005efa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201056.669774:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622434560 00000100:00100000:2.0:1788201056.669778:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622434560 00000100:00100000:2.0:1788201056.669839:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788201056.669847:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+15:7760:x1875064622434560:12345-0@lo:502: 00000100:00100000:2.0:1788201056.669979:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+15:7760:x1875064622434560:12345-0@lo:502: Request processed in 133us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201056.669986:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788201056.670039:0:7760:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7760:1875064622434560:0@lo:502: 00000020:01000000:0.0:1788201056.670058:0:7760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201056.670062:0:7760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201056.670064:0:7760:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788201056.670067:0:7760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788201056.671206:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788201056.671228:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788201056.671239:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00029c6000/0x72011f792b786a31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a38 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.671250:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b00029c6000/0x72011f792b786a31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a38 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201056.671260:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788201056.671262:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b0007c1d000 from 30 10000000:01000000:2.0:1788201056.671265:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201056.671293:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00029c7a00/0x72011f792b786a3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.671301:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b00029c7a00/0x72011f792b786a3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.671310:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b00029c7a00/0x72011f792b786a3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201056.671341:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005137800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622434688:0@lo:101: 00000100:00100000:2.0:1788201056.671384:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201056.671415:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8c16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201056.671432:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622434688 00000100:00100000:2.0:1788201056.671437:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622434688 00000100:00100000:2.0:1788201056.671472:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788201056.671480:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+15:5825:x1875064622434688:12345-0@lo:101: 00010000:00010000:2.0:1788201056.671491:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201056.671503:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b00029c6a00/0x72011f792b786a46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786a3f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.671663:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00029c6a00/0x72011f792b786a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786a3f expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.671674:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b00029c6a00/0x72011f792b786a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786a3f expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.671683:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c6a00, rc 0) 00000100:00100000:2.0:1788201056.671770:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:5825:x1875064622434688:12345-0@lo:101: Request processed in 290us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201056.671777:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788201056.671934:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005137800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622434688:0@lo:101: 00010000:00010000:0.0:1788201056.671948:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b00029c7a00/0x72011f792b786a3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a46 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201056.671955:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b00029c7a00/0x72011f792b786a3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786a46 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201056.672001:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622434816:0@lo:501: 00000100:00100000:0.0:1788201056.672027:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201056.672089:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0033212780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201056.672254:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622434816 00000100:00100000:2.0:1788201056.672258:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622434816 00000100:00100000:2.0:1788201056.672432:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788201056.672441:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+16:5825:x1875064622434816:12345-0@lo:501: 00000100:00100000:2.0:1788201056.672726:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+16:5825:x1875064622434816:12345-0@lo:501: Request processed in 274us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201056.672750:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788201056.672814:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622434816:0@lo:501: 00000100:00100000:3.0:1788201056.672845:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622434944:0@lo:503: 00000100:00100000:3.0:1788201056.672884:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201056.672919:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8e4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201056.673026:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622434944 00000100:00100000:0.0:1788201056.673031:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622434944 00000100:00100000:0.0:1788201056.673067:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788201056.673075:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:5825:x1875064622434944:12345-0@lo:503: 00000100:00100000:0.0:1788201056.673270:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:5825:x1875064622434944:12345-0@lo:503: Request processed in 195us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201056.673277:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788201056.673315:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622434944:0@lo:503: 00000100:00100000:0.0:1788201056.673483:0:7761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7761:1875064622435072:0@lo:502: 00000100:00100000:0.0:1788201056.673539:0:7761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201056.673558:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622435072 00000100:00100000:0.0:1788201056.673562:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622435072 00000100:00100000:0.0:1788201056.673580:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788201056.673586:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:7761:x1875064622435072:12345-0@lo:502: 00000100:00100000:0.0:1788201056.673749:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:7761:x1875064622435072:12345-0@lo:502: Request processed in 162us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201056.673755:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788201056.673786:0:7761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0003a84900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201056.673798:0:7761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7761:1875064622435072:0@lo:502: 00000100:00100000:0.0:1788201056.673836:0:7761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7761:1875064622435200:0@lo:502: 00000100:00100000:0.0:1788201056.673869:0:7761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201056.673886:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622435200 00000100:00100000:0.0:1788201056.673889:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622435200 00000100:00100000:0.0:1788201056.673905:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788201056.673910:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:7761:x1875064622435200:12345-0@lo:502: 00000100:00100000:0.0:1788201056.674033:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:7761:x1875064622435200:12345-0@lo:502: Request processed in 122us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201056.674040:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788201056.674065:0:7761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0003a84900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201056.674077:0:7761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7761:1875064622435200:0@lo:502: 00000040:00080000:0.0:1788201056.674095:0:7761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788201056.674161:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788201056.674178:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201056.674187:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00029c7a00/0x72011f792b786a3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a46 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201056.674208:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b00029c7a00/0x72011f792b786a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a46 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201056.674217:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788201056.674221:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b0007c1d000 from 5 10000000:01000000:0.0:1788201056.674223:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201056.674248:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000030400/0x72011f792b786a4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201056.674257:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0000030400/0x72011f792b786a4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201056.674266:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0000030400/0x72011f792b786a4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201056.674279:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622435328:0@lo:101: 00000100:00100000:0.0:1788201056.674304:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201056.674323:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b004055c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201056.674335:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622435328 00000100:00100000:0.0:1788201056.674338:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622435328 00000100:00100000:0.0:1788201056.674356:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788201056.674362:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:5825:x1875064622435328:12345-0@lo:101: 00010000:00010000:0.0:1788201056.674370:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201056.674381:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0000030c00/0x72011f792b786a54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786a4d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201056.674400:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0000030c00/0x72011f792b786a54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786a4d expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201056.674423:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0000030c00/0x72011f792b786a54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786a4d expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201056.674432:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000030c00, rc 0) 00000100:00100000:0.0:1788201056.674463:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622435328:12345-0@lo:101: Request processed in 101us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201056.674469:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788201056.674496:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622435328:0@lo:101: 00010000:00010000:0.0:1788201056.674508:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0000030400/0x72011f792b786a4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a54 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201056.674516:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0000030400/0x72011f792b786a4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786a54 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201056.674559:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622435456:0@lo:256: 00000100:00100000:0.0:1788201056.674587:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201056.674600:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b004055c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201056.674611:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622435456 00000100:00100000:0.0:1788201056.674614:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622435456 00000100:00100000:0.0:1788201056.674632:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788201056.674637:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622435456:12345-0@lo:256: 20000000:01000000:0.0:1788201056.674650:0:5819:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201056.674666:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201056.674669:0:5819:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788201056.674759:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622435456:12345-0@lo:256: Request processed in 120us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201056.674765:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788201056.674798:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622435456:0@lo:256: 10000000:01000000:0.0:1788201056.674834:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201056.674839:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000030400/0x72011f792b786a4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a54 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201056.674847:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0000030400/0x72011f792b786a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a54 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201056.674853:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788201056.674855:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788201056.674857:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788201056.674872:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201056.674879:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201056.674886:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201056.674896:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622435584:0@lo:101: 00000100:00100000:0.0:1788201056.674918:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201056.674943:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b004055c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201056.675432:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622435584 00000100:00100000:2.0:1788201056.675438:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622435584 00000100:00100000:2.0:1788201056.675473:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788201056.675482:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622435584:12345-0@lo:101: 00010000:00010000:2.0:1788201056.675492:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201056.675505:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b00029c7000/0x72011f792b786a62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786a5b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.675611:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00029c7000/0x72011f792b786a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786a5b expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.675622:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b00029c7000/0x72011f792b786a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786a5b expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.675630:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c7000, rc 0) 00000100:00100000:2.0:1788201056.675704:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622435584:12345-0@lo:101: Request processed in 222us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201056.675709:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788201056.675811:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622435584:0@lo:101: 00010000:00010000:0.0:1788201056.675822:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786a5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a62 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201056.675832:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786a5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786a62 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201056.675886:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622435712:0@lo:501: 00000100:00100000:0.0:1788201056.675911:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201056.675931:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b004055c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201056.675934:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622435712 00000100:00100000:3.0:1788201056.675939:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622435712 00000100:00100000:3.0:1788201056.675966:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788201056.675973:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622435712:12345-0@lo:501: 00000100:00100000:3.0:1788201056.676228:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622435712:12345-0@lo:501: Request processed in 255us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201056.676235:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788201056.676248:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622435712:0@lo:501: 00000100:00100000:2.0:1788201056.676273:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005134700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622435840:0@lo:503: 00000100:00100000:2.0:1788201056.676307:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201056.676333:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8c1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201056.676376:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622435840 00000100:00100000:0.0:1788201056.676380:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622435840 00000100:00100000:0.0:1788201056.676443:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788201056.676450:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622435840:12345-0@lo:503: 00000100:00100000:0.0:1788201056.676788:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622435840:12345-0@lo:503: Request processed in 338us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201056.676795:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788201056.676858:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005134700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622435840:0@lo:503: 00000100:00100000:2.0:1788201056.680066:0:7762:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005134700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7762:1875064622435968:0@lo:502: 00000100:00100000:2.0:1788201056.680172:0:7762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201056.680219:0:7762:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8c1240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201056.680344:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622435968 00000100:00100000:3.0:1788201056.680351:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622435968 00000100:00100000:3.0:1788201056.680396:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788201056.680405:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:7762:x1875064622435968:12345-0@lo:502: 00000100:00100000:3.0:1788201056.680742:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:7762:x1875064622435968:12345-0@lo:502: Request processed in 327us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201056.680750:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788201056.680791:0:7762:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005134700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7762:1875064622435968:0@lo:502: 00000020:01000000:1.0:1788201056.680819:0:7762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201056.680826:0:7762:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788201056.680833:0:7762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201056.680835:0:7762:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788201056.680846:0:7762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201056.680850:0:7762:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:01000000:1.0:1788201056.680870:0:7762:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788201056.680879:0:7762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201056.680899:0:7762:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b00067e3380) 00000020:00000080:1.0:1788201056.680919:0:7762:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788201056.680927:0:7762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201056.680999:0:7762:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788201056.681005:0:7762:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788201056.681012:0:7762:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72011f792b786a70 00010000:00080000:1.0:1788201056.681041:0:7762:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b003f5e4800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.114@tcp at head 00010000:00010000:1.0:1788201056.681613:0:7762:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788201056.681886:0:7762:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788201056.681897:0:7762:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788201056.683704:0:7762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201056.683933:0:7762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201056.683989:0:7762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788201056.684048:0:7762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788201056.685540:0:7763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788201056.685546:0:7763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788201056.686407:0:7762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201056.686424:0:7762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788201056.686457:0:7762:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788201056.686477:0:7762:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72011f792b786a77 00000100:00080000:2.0:1788201056.686488:0:7762:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201056.686494:0:7762:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b003f5e4800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788201056.686524:0:7762:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b0005137800 x1875064622436096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201056.686545:0:7762:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788201056.686575:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622436096:0@lo:8: 00000020:01000000:2.0:1788201056.686605:0:7762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201056.686610:0:7762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201056.686613:0:7762:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788201056.686616:0:7762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201056.686620:0:7762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201056.686622:0:7762:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788201056.686626:0:7762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788201056.686629:0:7762:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788201056.686643:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201056.686648:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201056.686658:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622436224:0@lo:400: 00000100:00100000:3.0:1788201056.686679:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622436480:0@lo:400: 00000100:00100000:2.0:1788201056.686699:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201056.686706:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622436096 00000100:00100000:3.0:1788201056.686713:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201056.686713:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622436096 00000100:00100000:2.0:1788201056.686729:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622436608:0@lo:400: 00000100:00100000:1.0:1788201056.686756:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622436480 00000100:00100000:1.0:1788201056.686760:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622436480 00000100:00100000:0.0:1788201056.686770:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622436352:0@lo:400: 00000100:00080000:3.0:1788201056.686788:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201056.686797:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201056.686811:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201056.686811:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622436480:12345-0@lo:400: 00000100:00100000:0.0:1788201056.686817:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201056.686823:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788201056.686846:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622436224 00000100:00100000:0.0:1788201056.686849:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622436224 00000100:00100000:2.0:1788201056.686865:0:7762:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7762:1875064622436736:0@lo:502: 00000100:00100000:0.0:1788201056.686875:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622436608 00000100:00100000:1.0:1788201056.686879:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622436480:12345-0@lo:400: Request processed in 70us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201056.686879:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622436608 00000100:00100000:1.0:1788201056.686890:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201056.686906:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201056.686914:0:7762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201056.686917:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201056.686918:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622436224:12345-0@lo:400: 00000100:00100000:1.0:1788201056.686926:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3291:x1875064622436096:12345-0@lo:8: 00000100:00100000:2.0:1788201056.686935:0:7762:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8c1d80 going to sleep for 11 seconds 00010000:00080000:1.0:1788201056.686948:0:6677:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 135 last 0 00000100:00100000:0.0:1788201056.686971:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622436224:12345-0@lo:400: Request processed in 56us (272us total) trans 0 rc 0/0 00000020:00000080:1.0:1788201056.686972:0:6677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72011f792b786a7e 00002000:00100000:1.0:1788201056.686987:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b003f5e2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788201056.686993:0:6677:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00010000:00080000:2.0:1788201056.686994:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035c04700 x1875064622436224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201056.686994:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000001:00000004:1.0:1788201056.687005:0:6677:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788201056.687015:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622436224:0@lo:400: 00000100:00100000:0.0:1788201056.687015:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788201056.687034:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622436608:12345-0@lo:400: 00000100:00100000:0.0:1788201056.687088:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622436608:12345-0@lo:400: Request processed in 58us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201056.687094:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788201056.687122:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622436736 00010000:00080000:2.0:1788201056.687126:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035c06d80 x1875064622436608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201056.687158:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622436736 00000100:00100000:2.0:1788201056.687171:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622436608:0@lo:400: 00000100:00100000:0.0:1788201056.687196:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788201056.687205:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:7762:x1875064622436736:12345-0@lo:502: 00002000:00100000:1.0:1788201056.687250:0:6677:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788201056.687487:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788201056.687511:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9b003f5e7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201056.687565:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3291:x1875064622436096:12345-0@lo:8: Request processed in 640us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201056.687574:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788201056.687612:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035c06a00 x1875064622436480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201056.687620:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622436480:0@lo:400: 00000100:00100000:0.0:1788201056.687741:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:7762:x1875064622436736:12345-0@lo:502: Request processed in 470us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201056.687750:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1788201056.687793:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201056.687807:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201056.687832:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622436352 00000100:00100000:1.0:1788201056.687837:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622436352 00000100:00100000:1.0:1788201056.687879:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201056.687887:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622436352:12345-0@lo:400: 00000100:00100000:1.0:1788201056.687930:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622436352:12345-0@lo:400: Request processed in 43us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201056.687938:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788201056.687943:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035c06300 x1875064622436352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201056.687955:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622436352:0@lo:400: 00000100:00080000:3.0:1788201056.688021:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788201056.688080:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0005137800 x1875064622436096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201056.688089:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201056.688103:0:3291:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788201056.688111:0:3291:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788201056.688116:0:3291:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788201056.688118:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b003f5e4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788201056.688216:0:3291:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788201056.688222:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622436096:0@lo:8: 00000100:00100000:2.0:1788201056.688251:0:7762:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:7762:1875064622436736:0@lo:502: 00000020:01000000:2.0:1788201056.688273:0:7762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201056.688430:0:7762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201056.688433:0:7762:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788201056.688438:0:7762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788201056.688495:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788201056.688513:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788201056.688522:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786a5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a62 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.688532:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a62 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201056.688540:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788201056.688543:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b000701cd40 from 1 10000000:01000000:2.0:1788201056.688545:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788201056.688570:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00029c7e00/0x72011f792b786a85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.688584:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b00029c7e00/0x72011f792b786a85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.688593:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b00029c7e00/0x72011f792b786a85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201056.688607:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622436864:0@lo:101: 00000100:00100000:2.0:1788201056.688639:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201056.688663:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8c1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201056.688676:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622436864 00000100:00100000:2.0:1788201056.688680:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622436864 00000100:00100000:2.0:1788201056.688703:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788201056.688709:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622436864:12345-0@lo:101: 00010000:00010000:2.0:1788201056.688718:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201056.688729:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b00029c6600/0x72011f792b786a8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786a85 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.688760:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00029c6600/0x72011f792b786a8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786a85 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.688769:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b00029c6600/0x72011f792b786a8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786a85 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.688777:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c6600, rc 0) 00000100:00100000:2.0:1788201056.688805:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622436864:12345-0@lo:101: Request processed in 96us (165us total) trans 0 rc 0/0 00000004:00080000:3.0:1788201056.688807:0:7763:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788201056.688813:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788201056.688844:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622436864:0@lo:101: 00010000:00010000:2.0:1788201056.688863:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b00029c7e00/0x72011f792b786a85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a8c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.688872:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b00029c7e00/0x72011f792b786a85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786a8c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201056.688913:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622436992:0@lo:501: 00000100:00100000:2.0:1788201056.688939:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201056.688951:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8c1d80 going to sleep for 11 seconds 00000004:00080000:3.0:1788201056.689104:0:7763:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 135813968681ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788201056.689306:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622436992 00000100:00100000:2.0:1788201056.689311:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622436992 00000100:00100000:2.0:1788201056.689343:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788201056.689350:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622436992:12345-0@lo:501: 00000100:00100000:2.0:1788201056.689827:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622436992:12345-0@lo:501: Request processed in 476us (885us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201056.689835:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788201056.689868:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622436992:0@lo:501: 10000000:01000000:2.0:1788201056.690684:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788201056.690693:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00029c7e00/0x72011f792b786a85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a8c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201056.690704:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b00029c7e00/0x72011f792b786a85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a8c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201056.711088:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622437120:0@lo:13: 00000004:00080000:0.0:1788201056.711438:0:7764:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788201056.711465:0:7764:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7764:1875064622437248:0@lo:7: 00000100:00100000:1.0:1788201056.711777:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201056.711860:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622437120 00000100:00100000:1.0:1788201056.711869:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622437120 00000100:00100000:1.0:1788201056.711961:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201056.711973:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1875064622437120:12345-0@lo:13: 00002000:00000024:1.0:1788201056.712010:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788201056.712083:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1875064622437120:12345-0@lo:13: Request processed in 112us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201056.712092:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788201056.712167:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788201056.712204:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0040679500 x1875064622437120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201056.712225:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622437120:0@lo:13: 00000100:00100000:0.0:1788201056.713808:0:7764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201056.713838:0:7764:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b004055c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201056.714833:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622437248 00000100:00100000:1.0:1788201056.714842:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622437248 00000100:00100000:1.0:1788201056.715030:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201056.715041:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7764:x1875064622437248:12345-0@lo:7: 00010000:00010000:3.0:1788201056.720864:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788201056.728496:0:6677:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788201056.728506:0:6677:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788201056.728601:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7764:x1875064622437248:12345-0@lo:7: Request processed in 13558us (14795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201056.728611:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788201056.728872:0:7764:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b002722ca80 x1875064622437248/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788201072 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201056.728887:0:7764:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7764:1875064622437248:0@lo:7: 00000004:00080000:0.0:1788201056.728901:0:7764:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788201056.728941:0:7764:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7764:1875064622437376:0@lo:5: 00000100:00100000:0.0:1788201056.728987:0:7764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201056.729023:0:7764:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b004055c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201056.730906:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622437376 00000100:00100000:1.0:1788201056.730916:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622437376 00000100:00100000:1.0:1788201056.731012:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201056.731022:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7764:x1875064622437376:12345-0@lo:5: 00002000:00080000:1.0:1788201056.731055:0:6678:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788201056.731060:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788201056.731485:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7764:x1875064622437376:12345-0@lo:5: Request processed in 464us (2497us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788201056.731493:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788201056.736487:0:7764:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b002722ca80 x1875064622437376/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201072 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201056.736511:0:7764:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7764:1875064622437376:0@lo:5: 00000004:00080000:1.0:1788201056.736526:0:7764:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788201056.736569:0:7764:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040679500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7764:1875064622437504:0@lo:700: 00000100:00100000:1.0:1788201056.736641:0:7764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201056.736699:0:7764:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201056.736835:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622437504 00000100:00100000:2.0:1788201056.736841:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622437504 00000100:00100000:2.0:1788201056.736926:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201056.736936:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7764:x1875064622437504:12345-0@lo:700: 00000100:00100000:2.0:1788201056.736977:0:6684:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6684:1875064622437632:0@lo:700: 00000100:00100000:2.0:1788201056.737005:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201056.737022:0:6684:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8c1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201056.737035:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622437632 00000100:00100000:2.0:1788201056.737038:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622437632 00000100:00100000:2.0:1788201056.737064:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201056.737070:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6684:x1875064622437632:12345-0@lo:700: 00000004:00080000:2.0:1788201056.762792:0:5849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:0.0:1788201056.792269:0:5834:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788201056.798367:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6684:x1875064622437632:12345-0@lo:700: Request processed in 61290us (61353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201056.798387:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788201056.798390:0:6684:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0005135500 x1875064622437632/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788201072 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201056.798405:0:6684:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6684:1875064622437632:0@lo:700: 40000000:02000000:2.0:1788201056.798418:0:6684:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:0.0:1788201056.878371:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7764:x1875064622437504:12345-0@lo:700: Request processed in 141428us (141720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201056.878386:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:0.0:1788201056.878430:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1788201056.878457:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1788201056.879855:0:7764:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0040679500 x1875064622437504/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788201072 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201056.879874:0:7764:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040679500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7764:1875064622437504:0@lo:700: 00000004:02000040:2.0:1788201056.928886:0:7764:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788201056.936366:0:7764:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7764:1875064622437760:0@lo:5: 00000100:00100000:2.0:1788201056.936435:0:7764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201056.936482:0:7764:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8c1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201056.936665:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622437760 00000100:00100000:0.0:1788201056.936672:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622437760 00000100:00100000:0.0:1788201056.936728:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201056.936749:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7764:x1875064622437760:12345-0@lo:5: 00002000:00080000:1.0:1788201056.941301:0:6675:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788201056.941321:0:6675:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00010000:00080000:2.0:1788201056.950888:0:7764:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0005135500 x1875064622437760/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201072 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201056.950905:0:7764:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788201056.950920:0:7764:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b0005135500 x1875064622437760/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201072 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201056.950932:0:7764:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005135500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7764:1875064622437760:0@lo:5: 00000004:00080000:2.0:1788201056.950955:0:7764:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788201056.951007:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7764:x1875064622437760:12345-0@lo:5: Request processed in 13946us (14258us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788201056.951018:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788201057.740534:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201058.059947:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201058.060044:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622437888:0@lo:13: 00000100:00100000:0.0:1788201058.060113:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201058.060205:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622437888 00000100:00100000:2.0:1788201058.060214:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622437888 00000100:00100000:2.0:1788201058.060277:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201058.060287:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622437888:12345-0@lo:13: 00002000:00000024:2.0:1788201058.060321:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201058.060369:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622437888:12345-0@lo:13: Request processed in 84us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201058.060377:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788201058.060442:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788201058.060475:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b002722ca80 x1875064622437888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201058.060495:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622437888:0@lo:13: 00010000:00010000:0.0:1788201058.763552:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201059.788529:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201060.212293:0:7989:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788201060.811501:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201061.835270:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201062.155570:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622438016:0@lo:400: 00000100:00100000:0.0:1788201062.155595:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622438400:0@lo:400: 00000100:00100000:2.0:1788201062.155647:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201062.155755:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622438144:0@lo:400: 00000100:00100000:3.0:1788201062.155997:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622438016 00000100:00100000:3.0:1788201062.156005:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622438016 00000100:00100000:3.0:1788201062.156050:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788201062.156060:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3295:x1875064622438016:12345-0@lo:400: 00000100:00100000:0.0:1788201062.162817:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201062.162953:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622438400 00000100:00100000:0.0:1788201062.162963:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622438400 00000100:00100000:0.0:1788201062.163021:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788201062.163032:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622438400:12345-0@lo:400: 00000100:00100000:0.0:1788201062.163101:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622438400:12345-0@lo:400: Request processed in 72us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201062.163108:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788201062.163128:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788201062.163185:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b002722ce00 x1875064622438400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201062.163201:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622438400:0@lo:400: 00000100:00100000:0.0:1788201062.163311:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1875064622438272:0@lo:400: 00000100:00100000:0.0:1788201062.163631:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201062.163997:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622438272 00000100:00100000:0.0:1788201062.164003:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622438272 00000100:00100000:0.0:1788201062.164035:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201062.164042:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875064622438272:12345-0@lo:400: 00000100:00100000:0.0:1788201062.164088:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875064622438272:12345-0@lo:400: Request processed in 45us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201062.164095:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788201062.164113:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788201062.164156:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b002722f100 x1875064622438272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201062.164180:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1875064622438272:0@lo:400: 00000100:00100000:0.0:1788201062.164939:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622438784:0@lo:13: 00000100:00100000:0.0:1788201062.164991:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201062.165148:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622438784 00000100:00100000:2.0:1788201062.165154:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622438784 00000100:00100000:2.0:1788201062.165204:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201062.165213:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003593ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1875064622438784:12345-0@lo:13: 00002000:00000024:2.0:1788201062.165241:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201062.165291:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003593ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1875064622438784:12345-0@lo:13: Request processed in 80us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201062.165298:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788201062.165316:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788201062.165343:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b002722f100 x1875064622438784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201062.165360:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622438784:0@lo:13: 00000100:00100000:2.0:1788201062.165387:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622438528:0@lo:400: 00000100:00100000:2.0:1788201062.165424:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201062.167440:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622438528 00000100:00100000:1.0:1788201062.167453:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622438528 00000100:00100000:1.0:1788201062.167508:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201062.167517:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875064622438528:12345-0@lo:400: 00000100:00100000:1.0:1788201062.167594:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875064622438528:12345-0@lo:400: Request processed in 78us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201062.167611:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788201062.167633:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788201062.168557:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b002722fb80 x1875064622438528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201062.168572:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622438528:0@lo:400: 00000100:00100000:1.0:1788201062.168637:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201062.168667:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622438144 00000100:00100000:1.0:1788201062.168671:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622438144 00000100:00100000:1.0:1788201062.168709:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201062.168717:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622438144:12345-0@lo:400: 00000100:00100000:1.0:1788201062.168755:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622438144:12345-0@lo:400: Request processed in 39us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201062.168761:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788201062.168791:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b002722df80 x1875064622438144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201062.168800:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622438144:0@lo:400: 00000100:00100000:1.0:1788201062.168818:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622438656:0@lo:400: 00000100:00100000:1.0:1788201062.168846:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201062.168868:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622438656 00000100:00100000:1.0:1788201062.168872:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622438656 00000100:00100000:1.0:1788201062.168895:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201062.168901:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3292:x1875064622438656:12345-0@lo:400: 00000100:00100000:1.0:1788201062.168944:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3292:x1875064622438656:12345-0@lo:400: Request processed in 43us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201062.170947:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3295:x1875064622438016:12345-0@lo:400: Request processed in 14883us (15293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201062.170962:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788201062.171418:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201062.171465:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622438016:0@lo:400: 00010000:00080000:1.0:1788201062.171504:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b002722dc00 x1875064622438656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201062.171517:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622438656:0@lo:400: 00000001:00080000:0.0:1788201062.262332:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788201062.872093:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201063.179369:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622438912:0@lo:13: 00000100:00100000:1.0:1788201063.179430:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201063.179586:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622438912 00000100:00100000:0.0:1788201063.179593:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622438912 00000100:00100000:0.0:1788201063.181942:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788201063.181957:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622438912:12345-0@lo:13: 00002000:00000024:0.0:1788201063.181992:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201063.182150:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622438912:12345-0@lo:13: Request processed in 183us (2703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201063.182157:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788201063.183595:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035938e00 x1875064622438912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201063.183617:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622438912:0@lo:13: 00010000:00010000:0.0:1788201063.885242:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201064.908328:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201065.332223:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201065.332433:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614027392 00000100:00100000:2.0:1788201065.332444:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614027392 00000100:00100000:2.0:1788201065.332493:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 110 00000100:00100000:2.0:1788201065.332501:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2347:x1875064614027392:12345-192.168.203.14@tcp:250: 00010000:00080000:2.0:1788201065.332529:0:5821:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from e79fcbf4-8d24-427b-827f-6b1cb026b088@192.168.203.14@tcp t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:2.0:1788201065.332556:0:5821:0:(genops.c:1406:class_connect()) connect: client e79fcbf4-8d24-427b-827f-6b1cb026b088, cookie 0x72011f792b786a93 00000100:00080000:2.0:1788201065.332685:0:5821:0:(import.c:65:import_set_state_nolock()) ffff9b0035c09800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201065.332748:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+5:2347:x1875064614027392:12345-192.168.203.14@tcp:250: Request processed in 247us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201065.332756:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 110 00000100:00100000:3.0:1788201065.337623:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201065.337728:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614027520 00000100:00100000:0.0:1788201065.337737:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614027520 00000100:00100000:0.0:1788201065.337796:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 111 00000100:00100000:0.0:1788201065.337806:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+5:5574:x1875064614027520:12345-192.168.203.14@tcp:101: 00010000:00010000:0.0:1788201065.337823:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201065.337840:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b004217d400/0x72011f792b786a9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2c0b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201065.337869:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b004217d400/0x72011f792b786a9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c0b expref: 6 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201065.337890:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b004217d400/0x72011f792b786a9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c0b expref: 6 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201065.337913:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b004217d400, rc 0) 00000100:00100000:0.0:1788201065.337976:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+6:5574:x1875064614027520:12345-192.168.203.14@tcp:101: Request processed in 171us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201065.337983:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 111 00000100:00100000:1.0:1788201065.350125:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201065.350320:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614027648 00000100:00100000:2.0:1788201065.350330:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614027648 00000100:00100000:2.0:1788201065.350384:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 112 00000100:00100000:2.0:1788201065.350393:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+6:5574:x1875064614027648:12345-192.168.203.14@tcp:501: 00000100:00100000:2.0:1788201065.350617:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+6:5574:x1875064614027648:12345-192.168.203.14@tcp:501: Request processed in 223us (502us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201065.350625:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 112 00000100:00100000:3.0:1788201065.352478:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201065.352560:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614027776 00000100:00100000:1.0:1788201065.352568:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614027776 00000100:00100000:1.0:1788201065.352614:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 113 00000100:00100000:1.0:1788201065.352624:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+6:5574:x1875064614027776:12345-192.168.203.14@tcp:101: 00010000:00010000:1.0:1788201065.352666:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201065.352691:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0001680a00/0x72011f792b786aa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2c12 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201065.352719:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0001680a00/0x72011f792b786aa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c12 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201065.352730:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0001680a00/0x72011f792b786aa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c12 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201065.352741:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680a00, rc 0) 00000100:00100000:1.0:1788201065.352796:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+7:5574:x1875064614027776:12345-192.168.203.14@tcp:101: Request processed in 174us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201065.352803:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 113 00000100:00100000:2.0:1788201065.369560:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201065.369637:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614027904 00000100:00100000:3.0:1788201065.369667:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614027904 00000100:00100000:3.0:1788201065.369730:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 114 00000100:00100000:3.0:1788201065.369742:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+7:5574:x1875064614027904:12345-192.168.203.14@tcp:501: 00000100:00100000:3.0:1788201065.370024:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+8:5574:x1875064614027904:12345-192.168.203.14@tcp:501: Request processed in 273us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201065.370033:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 114 00000100:00100000:1.0:1788201065.372901:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201065.373024:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614028032 00000100:00100000:2.0:1788201065.373034:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614028032 00000100:00100000:2.0:1788201065.373091:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 115 00000100:00100000:2.0:1788201065.373100:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+8:5574:x1875064614028032:12345-192.168.203.14@tcp:503: 00000100:00100000:2.0:1788201065.373376:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+8:5574:x1875064614028032:12345-192.168.203.14@tcp:503: Request processed in 277us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201065.373384:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 115 00000100:00100000:0.0:1788201065.385350:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201065.385430:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614028160 00000100:00100000:3.0:1788201065.385440:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614028160 00000100:00100000:3.0:1788201065.385501:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 116 00000100:00100000:3.0:1788201065.385511:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0009fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+8:5593:x1875064614028160:12345-192.168.203.14@tcp:502: 00000100:00100000:3.0:1788201065.385887:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0009fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+8:5593:x1875064614028160:12345-192.168.203.14@tcp:502: Request processed in 376us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201065.385896:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 116 00000100:00100000:2.0:1788201065.417814:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201065.417944:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614028288 00000100:00100000:3.0:1788201065.417954:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614028288 00000100:00100000:3.0:1788201065.418006:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 117 00000100:00100000:3.0:1788201065.418023:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0009fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+8:5593:x1875064614028288:12345-192.168.203.14@tcp:502: 00000100:00100000:3.0:1788201065.418693:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0009fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+8:5593:x1875064614028288:12345-192.168.203.14@tcp:502: Request processed in 651us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201065.418704:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 117 00000100:00100000:0.0:1788201065.422800:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201065.423509:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614028416 00000100:00100000:2.0:1788201065.423519:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614028416 00000100:00100000:2.0:1788201065.423618:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 118 00000100:00100000:2.0:1788201065.423628:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0009fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+8:5574:x1875064614028416:12345-192.168.203.14@tcp:101: 00010000:00010000:2.0:1788201065.423645:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201065.423681:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b00029c7600/0x72011f792b786aa8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2c3c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201065.423710:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00029c7600/0x72011f792b786aa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c3c expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201065.423720:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b00029c7600/0x72011f792b786aa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c3c expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201065.423729:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c7600, rc 0) 00000100:00100000:2.0:1788201065.423779:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0009fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+9:5574:x1875064614028416:12345-192.168.203.14@tcp:101: Request processed in 153us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201065.423786:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 118 00000100:00100000:2.0:1788201065.429604:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201065.430277:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614028544 00000100:00100000:3.0:1788201065.430287:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614028544 00000100:00100000:3.0:1788201065.430340:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 119 00000100:00100000:3.0:1788201065.430350:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00109dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+9:5574:x1875064614028544:12345-192.168.203.14@tcp:256: 20000000:01000000:3.0:1788201065.430374:0:5821:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788201065.430397:0:5821:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788201065.430406:0:5821:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788201065.430409:0:5821:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788201065.430412:0:5821:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788201065.436076:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00109dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+9:5574:x1875064614028544:12345-192.168.203.14@tcp:256: Request processed in 5718us (6472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201065.436090:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 119 00000100:00100000:0.0:1788201065.439347:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201065.439751:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614028672 00000100:00100000:3.0:1788201065.439760:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614028672 00000100:00100000:3.0:1788201065.439809:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 120 00000100:00100000:3.0:1788201065.439819:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00109de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+9:5574:x1875064614028672:12345-192.168.203.14@tcp:101: 00010000:00010000:3.0:1788201065.439835:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201065.439861:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b00126fd400/0x72011f792b786aaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2c43 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201065.439887:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00126fd400/0x72011f792b786aaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c43 expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201065.439898:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b00126fd400/0x72011f792b786aaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c43 expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201065.439906:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fd400, rc 0) 00000100:00100000:3.0:1788201065.439953:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00109de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:5574:x1875064614028672:12345-192.168.203.14@tcp:101: Request processed in 136us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201065.439958:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 120 00000100:00100000:2.0:1788201065.457031:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201065.457580:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614028800 00000100:00100000:3.0:1788201065.457592:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614028800 00000100:00100000:3.0:1788201065.457658:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 121 00000100:00100000:3.0:1788201065.457677:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:5574:x1875064614028800:12345-192.168.203.14@tcp:501: 00000100:00100000:3.0:1788201065.457959:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:5574:x1875064614028800:12345-192.168.203.14@tcp:501: Request processed in 290us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201065.457967:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 121 00000100:00100000:2.0:1788201065.462226:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201065.462450:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614028928 00000100:00100000:1.0:1788201065.462459:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614028928 00000100:00100000:1.0:1788201065.462515:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 122 00000100:00100000:1.0:1788201065.462525:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:5574:x1875064614028928:12345-192.168.203.14@tcp:503: 00000100:00100000:1.0:1788201065.462902:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:5574:x1875064614028928:12345-192.168.203.14@tcp:503: Request processed in 377us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201065.462911:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 122 00000100:00100000:0.0:1788201065.468838:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201065.468883:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614029056 00000100:00100000:0.0:1788201065.468891:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614029056 00000100:00100000:0.0:1788201065.468938:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 123 00000100:00100000:0.0:1788201065.468946:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:5597:x1875064614029056:12345-192.168.203.14@tcp:502: 00000100:00100000:0.0:1788201065.469530:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:5597:x1875064614029056:12345-192.168.203.14@tcp:502: Request processed in 583us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201065.469539:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 123 00000100:00100000:2.0:1788201065.472795:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201065.472874:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614029184 00000100:00100000:3.0:1788201065.472883:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614029184 00000100:00100000:3.0:1788201065.472934:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 124 00000100:00100000:3.0:1788201065.472943:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:5597:x1875064614029184:12345-192.168.203.14@tcp:502: 00000100:00100000:3.0:1788201065.473203:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:5597:x1875064614029184:12345-192.168.203.14@tcp:502: Request processed in 260us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201065.473211:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 124 00000100:00100000:2.0:1788201065.478566:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201065.478647:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614029312 00000100:00100000:0.0:1788201065.478657:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614029312 00000100:00100000:0.0:1788201065.478712:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:0.0:1788201065.478720:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2347:x1875064614029312:12345-192.168.203.14@tcp:38: 00010000:00080000:0.0:1788201065.478747:0:5827:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:0.0:1788201065.478794:0:5827:0:(genops.c:1406:class_connect()) connect: client aa6eef1a-3f03-469a-ac4c-2a406b6709bc, cookie 0x72011f792b786ab6 00000004:00100000:0.0:1788201065.478822:0:5827:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788201065.478828:0:5827:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788201065.516552:0:5827:0:(import.c:65:import_set_state_nolock()) ffff9b003f8ee000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201065.516630:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2347:x1875064614029312:12345-192.168.203.14@tcp:38: Request processed in 37907us (38072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201065.516654:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00010000:00010000:0.0:1788201065.931702:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201066.528208:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201066.528241:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201066.528345:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614029568 00000100:00100000:2.0:1788201066.528356:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614029568 00000100:00100000:2.0:1788201066.528429:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614029440 00000100:00100000:2.0:1788201066.528434:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614029440 00000100:00100000:2.0:1788201066.528652:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:2.0:1788201066.528685:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:5574:x1875064614029568:12345-192.168.203.14@tcp:41: 00000004:00000024:2.0:1788201066.528726:0:5828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788201066.528785:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:5574:x1875064614029568:12345-192.168.203.14@tcp:41: Request processed in 103us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201066.528792:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:2.0:1788201066.528810:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:2.0:1788201066.528817:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003593bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:0:x1875064614029440:12345-192.168.203.14@tcp:41: 00000004:00000024:2.0:1788201066.528828:0:5828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788201066.528848:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003593bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:0:x1875064614029440:12345-192.168.203.14@tcp:41: Request processed in 32us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201066.528854:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00080000:3.0:1788201066.531268:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201066.531999:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201066.532178:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614029696 00000100:00100000:1.0:1788201066.532189:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614029696 00000100:00100000:1.0:1788201066.532242:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:1.0:1788201066.532252:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:5574:x1875064614029696:12345-192.168.203.14@tcp:40: 00000100:00100000:1.0:1788201066.532343:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:5574:x1875064614029696:12345-192.168.203.14@tcp:40: Request processed in 92us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201066.532365:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:2.0:1788201066.536207:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201066.536243:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201066.536326:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614030080 00000100:00100000:0.0:1788201066.536335:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614030080 00000100:00100000:0.0:1788201066.536387:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 125 00000100:00100000:0.0:1788201066.536405:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2348:x1875064614030080:12345-192.168.203.14@tcp:400: 00000100:00100000:0.0:1788201066.536542:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2348:x1875064614030080:12345-192.168.203.14@tcp:400: Request processed in 146us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201066.536549:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 125 00000100:00100000:1.0:1788201066.538718:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614029824 00000100:00100000:1.0:1788201066.538731:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614029824 00000100:00100000:1.0:1788201066.538783:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:1.0:1788201066.538790:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2347:x1875064614029824:12345-192.168.203.14@tcp:8: 00010000:00080000:1.0:1788201066.538820:0:7765:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:1.0:1788201066.538850:0:7765:0:(genops.c:1406:class_connect()) connect: client aa6eef1a-3f03-469a-ac4c-2a406b6709bc, cookie 0x72011f792b786abd 00002000:00100000:1.0:1788201066.538861:0:7765:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aa6eef1a-3f03-469a-ac4c-2a406b6709bc/ffff9b001f908800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201066.538884:0:7765:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788201066.539310:0:7765:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788201066.539341:0:7765:0:(import.c:65:import_set_state_nolock()) ffff9b001f90b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201066.539406:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2347:x1875064614029824:12345-192.168.203.14@tcp:8: Request processed in 615us (3162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201066.539415:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:2.0:1788201066.541287:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201066.541335:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201066.541414:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614029952 00000100:00100000:3.0:1788201066.541423:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614029952 00000100:00100000:3.0:1788201066.541715:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:3.0:1788201066.541723:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1875064614029952:12345-192.168.203.14@tcp:8: 00010000:00080000:3.0:1788201066.541751:0:6675:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:3.0:1788201066.541779:0:6675:0:(genops.c:1406:class_connect()) connect: client aa6eef1a-3f03-469a-ac4c-2a406b6709bc, cookie 0x72011f792b786ac4 00002000:00100000:3.0:1788201066.541790:0:6675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aa6eef1a-3f03-469a-ac4c-2a406b6709bc/ffff9b001f80b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788201066.541809:0:6675:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788201066.542253:0:6675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788201066.542280:0:6675:0:(import.c:65:import_set_state_nolock()) ffff9b001f80a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201066.542351:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2347:x1875064614029952:12345-192.168.203.14@tcp:8: Request processed in 626us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201066.542358:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:1.0:1788201066.542918:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614030208 00000100:00100000:1.0:1788201066.542925:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614030208 00000100:00100000:1.0:1788201066.542964:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:1.0:1788201066.542972:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:5574:x1875064614030208:12345-192.168.203.14@tcp:33: 00000004:00080000:1.0:1788201066.575166:0:5830:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 32139us 00000004:00200000:1.0:1788201066.586838:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1788201066.587624:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:5574:x1875064614030208:12345-192.168.203.14@tcp:33: Request processed in 44637us (46329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201066.587640:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:2.0:1788201066.827783:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201066.827955:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614030336 00000100:00100000:3.0:1788201066.827982:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614030336 00000100:00100000:3.0:1788201066.828047:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:3.0:1788201066.828057:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:5615:x1875064614030336:12345-192.168.203.14@tcp:101: 00010000:00010000:3.0:1788201066.828082:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201066.831030:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd800/0x72011f792b786acb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2c6d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201066.831113:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fce00/0x72011f792b786ad2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201066.831126:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fce00/0x72011f792b786ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201066.831168:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fce00/0x72011f792b786ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201066.832215:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788201066.832221:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201066.832543:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fce00/0x72011f792b786ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201066.833070:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd800/0x72011f792b786acb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c6d expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201066.833093:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fce00/0x72011f792b786ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c6d expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201066.833101:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00109a1100) 00010000:00010000:3.0:1788201066.833104:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201066.833107:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fce00, rc 0) 00000100:00100000:3.0:1788201066.833235:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:5615:x1875064614030336:12345-192.168.203.14@tcp:101: Request processed in 5177us (5464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201066.833245:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00010000:00010000:0.0:1788201066.955756:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201067.276187:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622439040:0@lo:13: 00000100:00100000:0.0:1788201067.276273:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201067.276366:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622439040 00000100:00100000:0.0:1788201067.276374:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622439040 00000100:00100000:0.0:1788201067.276437:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788201067.276448:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622439040:12345-0@lo:13: 00002000:00000024:0.0:1788201067.276474:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201067.276519:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622439040:12345-0@lo:13: Request processed in 73us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201067.276526:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788201067.276547:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201067.276987:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622439296:0@lo:400: 00000100:00100000:2.0:1788201067.277022:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201067.277043:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788201067.277048:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622439168:0@lo:400: 00000100:00100000:2.0:1788201067.277074:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201067.277106:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622439680:0@lo:400: 00000100:00100000:2.0:1788201067.277126:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201067.277165:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622439168 00000100:00100000:2.0:1788201067.277184:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622439168 00000100:00100000:2.0:1788201067.277216:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788201067.277222:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622439168:12345-0@lo:400: 00000100:00100000:2.0:1788201067.277255:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622439168:12345-0@lo:400: Request processed in 34us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201067.277261:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788201067.277287:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622439296 00000100:00100000:2.0:1788201067.277290:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622439296 00000100:00100000:2.0:1788201067.277310:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622439680 00000100:00100000:2.0:1788201067.277312:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622439680 00000100:00100000:2.0:1788201067.277331:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201067.277336:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622439296:12345-0@lo:400: 00000100:00100000:2.0:1788201067.277364:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622439296:12345-0@lo:400: Request processed in 27us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201067.277370:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201067.277379:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201067.277384:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622439680:12345-0@lo:400: 00000100:00100000:2.0:1788201067.277404:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622439680:12345-0@lo:400: Request processed in 20us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201067.277409:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201067.277432:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622439168:0@lo:400: 00000100:00100000:2.0:1788201067.277446:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622439680:0@lo:400: 00000100:00100000:2.0:1788201067.277454:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622439296:0@lo:400: 00000100:00100000:2.0:1788201067.277507:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622439424:0@lo:400: 00000100:00100000:2.0:1788201067.277529:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201067.277550:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201067.277555:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622439552:0@lo:400: 00000100:00100000:2.0:1788201067.277575:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201067.277814:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788201067.277903:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035938000 x1875064622439040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201067.277916:0:3295:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788201067.277939:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622439040:0@lo:13: 00000100:00100000:2.0:1788201067.278005:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622439424 00000100:00100000:2.0:1788201067.278010:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622439424 00000100:00100000:2.0:1788201067.278046:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788201067.278052:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622439424:12345-0@lo:400: 00000100:00100000:2.0:1788201067.278094:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622439424:12345-0@lo:400: Request processed in 42us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201067.278099:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788201067.278124:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622439424:0@lo:400: 00000100:00080000:0.0:1788201067.278770:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201067.281332:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622439552 00000100:00100000:1.0:1788201067.281347:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622439552 00000100:00100000:1.0:1788201067.281415:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201067.281426:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622439552:12345-0@lo:400: 00000100:00100000:1.0:1788201067.281524:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622439552:12345-0@lo:400: Request processed in 100us (3947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201067.281531:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788201067.281597:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b002722dc00 x1875064622439552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201067.281614:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622439552:0@lo:400: 00000100:00080000:1.0:1788201067.281642:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201067.980035:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201068.300157:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201068.300190:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622439808:0@lo:13: 00000100:00100000:1.0:1788201068.300279:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201068.300540:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622439808 00000100:00100000:0.0:1788201068.300550:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622439808 00000100:00100000:0.0:1788201068.300619:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201068.300630:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622439808:12345-0@lo:13: 00002000:00000024:0.0:1788201068.300687:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201068.300750:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622439808:12345-0@lo:13: Request processed in 121us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201068.300757:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788201068.300845:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035938000 x1875064622439808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201068.300867:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622439808:0@lo:13: 00010000:00010000:0.0:1788201069.004304:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201069.098791:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201069.098982:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614030464 00000100:00100000:2.0:1788201069.098994:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614030464 00000100:00100000:2.0:1788201069.099233:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:2.0:1788201069.099250:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:5667:x1875064614030464:12345-192.168.203.14@tcp:41: 00000004:00000024:2.0:1788201069.099310:0:5828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:1.0:1788201069.099346:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201069.099398:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:5667:x1875064614030464:12345-192.168.203.14@tcp:41: Request processed in 151us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201069.099406:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:2.0:1788201069.105020:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201069.105333:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614030592 00000100:00100000:0.0:1788201069.105355:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614030592 00000100:00100000:0.0:1788201069.105462:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:0.0:1788201069.105475:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:5667:x1875064614030592:12345-192.168.203.14@tcp:13: 00002000:00000024:0.0:1788201069.105507:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788201069.105673:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201069.105894:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:5667:x1875064614030592:12345-192.168.203.14@tcp:13: Request processed in 421us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201069.105903:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:0.0:1788201069.108011:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201069.108177:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614030720 00000100:00100000:2.0:1788201069.108189:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614030720 00000100:00100000:2.0:1788201069.108269:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:2.0:1788201069.108281:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:5667:x1875064614030720:12345-192.168.203.14@tcp:13: 00002000:00000024:2.0:1788201069.108333:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201069.108436:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:5667:x1875064614030720:12345-192.168.203.14@tcp:13: Request processed in 150us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201069.108465:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00080000:1.0:1788201069.108721:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1788201069.879633:0:6702:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa6eef1a-3f03-469a-ac4c-2a406b6709bc 00010000:00010000:0.0:1788201070.027491:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788201070.959300:0:5849:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aa6eef1a-3f03-469a-ac4c-2a406b6709bc 00000001:00100000:3.0:1788201070.967657:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa6eef1a-3f03-469a-ac4c-2a406b6709bc 00010000:00010000:0.0:1788201071.051280:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201071.883377:0:8296:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788201071.910960:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201071.911018:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201071.911065:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201071.911152:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201071.911194:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614030848 00000100:00100000:1.0:1788201071.911206:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614030848 00000100:00100000:1.0:1788201071.911273:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 127 00000100:00100000:1.0:1788201071.911284:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2350:x1875064614030848:12345-192.168.203.14@tcp:400: 00000100:00100000:1.0:1788201071.911370:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2350:x1875064614030848:12345-192.168.203.14@tcp:400: Request processed in 87us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201071.911389:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 127 00000100:00100000:1.0:1788201071.911445:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614031232 00000100:00100000:1.0:1788201071.911449:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614031232 00000100:00100000:1.0:1788201071.911489:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614031104 00000100:00100000:1.0:1788201071.911493:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614031104 00000100:00100000:1.0:1788201071.911518:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:1.0:1788201071.911525:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2350:x1875064614031232:12345-192.168.203.14@tcp:400: 00000100:00100000:1.0:1788201071.911555:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2350:x1875064614031232:12345-192.168.203.14@tcp:400: Request processed in 31us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201071.911561:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:1.0:1788201071.911571:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:1.0:1788201071.911576:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2350:x1875064614031104:12345-192.168.203.14@tcp:400: 00000100:00100000:1.0:1788201071.911594:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2350:x1875064614031104:12345-192.168.203.14@tcp:400: Request processed in 19us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201071.911599:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00080000:1.0:1788201071.911762:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201071.911767:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201071.912223:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614030976 00000100:00100000:3.0:1788201071.912231:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614030976 00000100:00100000:3.0:1788201071.912288:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:3.0:1788201071.912297:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2350:x1875064614030976:12345-192.168.203.14@tcp:400: 00000100:00100000:3.0:1788201071.912346:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2350:x1875064614030976:12345-192.168.203.14@tcp:400: Request processed in 51us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201071.912353:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00080000:1.0:1788201071.913117:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788201072.087905:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201072.398535:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201072.398573:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622439936:0@lo:13: 00000100:00100000:3.0:1788201072.398658:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201072.398895:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622439936 00000100:00100000:0.0:1788201072.398902:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622439936 00000100:00100000:0.0:1788201072.398966:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788201072.398976:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622439936:12345-0@lo:13: 00002000:00000024:0.0:1788201072.399024:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201072.399085:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622439936:12345-0@lo:13: Request processed in 110us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201072.399092:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201072.399431:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1875064622440320:0@lo:400: 00000100:00100000:1.0:1788201072.399465:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201072.399486:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201072.399492:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622440192:0@lo:400: 00000100:00100000:1.0:1788201072.399512:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201072.399701:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622440448:0@lo:400: 00000100:00100000:2.0:1788201072.399731:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201072.399764:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788201072.399769:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622440064:0@lo:400: 00000100:00100000:2.0:1788201072.399796:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201072.399815:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1875064622440576:0@lo:400: 00000100:00100000:2.0:1788201072.399833:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201072.400051:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201072.400068:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622440320 00000100:00100000:3.0:1788201072.400073:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622440320 00000100:00100000:3.0:1788201072.400121:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622440192 00000100:00100000:3.0:1788201072.400124:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622440192 00000100:00100000:3.0:1788201072.400165:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622440576 00000100:00100000:3.0:1788201072.400169:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622440576 00000100:00100000:3.0:1788201072.400198:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201072.400217:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875064622440320:12345-0@lo:400: 00000100:00100000:3.0:1788201072.400277:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875064622440320:12345-0@lo:400: Request processed in 63us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201072.400284:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201072.400298:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201072.400304:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622440192:12345-0@lo:400: 00000100:00100000:3.0:1788201072.400327:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622440192:12345-0@lo:400: Request processed in 24us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201072.400333:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201072.400343:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201072.400349:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875064622440576:12345-0@lo:400: 00000100:00100000:3.0:1788201072.400374:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875064622440576:12345-0@lo:400: Request processed in 25us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201072.400380:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201072.400419:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622440192:0@lo:400: 00000100:00100000:3.0:1788201072.400429:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1875064622440320:0@lo:400: 00010000:00080000:3.0:1788201072.400461:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035939f80 x1875064622439936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201072.400477:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622439936:0@lo:13: 00000100:00080000:2.0:1788201072.402015:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201072.402074:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1875064622440576:0@lo:400: 00000100:00100000:1.0:1788201072.402349:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622440448 00000100:00100000:1.0:1788201072.402355:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622440448 00000100:00100000:1.0:1788201072.402415:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788201072.402435:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622440448:12345-0@lo:400: 00000100:00100000:1.0:1788201072.402508:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622440448:12345-0@lo:400: Request processed in 75us (2775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201072.402515:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788201072.402545:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622440064 00000100:00100000:1.0:1788201072.402549:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622440064 00000100:00100000:1.0:1788201072.402575:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788201072.402582:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000506a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622440064:12345-0@lo:400: 00000100:00100000:1.0:1788201072.402612:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000506a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622440064:12345-0@lo:400: Request processed in 31us (2815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201072.402618:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788201072.402993:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622440064:0@lo:400: 00010000:00080000:0.0:1788201072.403008:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0027576d80 x1875064622440448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201072.403018:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622440448:0@lo:400: 00000100:00080000:2.0:1788201072.404342:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201073.099745:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201073.432666:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201073.432697:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622440704:0@lo:13: 00000100:00100000:0.0:1788201073.432771:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201073.432936:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622440704 00000100:00100000:0.0:1788201073.432944:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622440704 00000100:00100000:0.0:1788201073.432992:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788201073.433001:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622440704:12345-0@lo:13: 00002000:00000024:0.0:1788201073.434439:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201073.434527:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622440704:12345-0@lo:13: Request processed in 1524us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201073.434537:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788201073.436986:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b003593a680 x1875064622440704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201073.437013:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622440704:0@lo:13: 00010000:00010000:3.0:1788201074.132556:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201075.151328:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201075.483618:0:8445:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcda5ef7c0 20000000:00000080:1.0:1788201075.483643:0:8445:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b00066aa400 uarg=0000000000000000 20000000:01000000:1.0:1788201075.483689:0:8445:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788201075.483692:0:8445:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788201075.483695:0:8445:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788201075.483701:0:8445:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788201075.483706:0:8445:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788201075.484367:0:8445:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788201075.484371:0:8445:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788201075.484610:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788201075.484613:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788201075.486090:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788201075.487396:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788201075.487462:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788201075.487497:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1788201075.487516:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788201075.487519:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788201075.489339:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788201075.490120:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788201075.490463:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788201075.490521:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788201075.490543:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788201075.490546:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788201075.493022:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788201075.493799:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788201075.493930:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788201075.493990:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788201075.494013:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788201075.494017:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788201075.495924:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788201075.496952:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788201075.497032:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788201075.497072:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1788201075.497097:0:8445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788201075.497125:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b00126fd800/0x72011f792b786ad9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.498884:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0000030800/0x72011f792b7869d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b7869cf expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.498896:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0001681400/0x72011f792b786a00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b7869f9 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.498902:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b00126fd200/0x72011f792b786a2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786a23 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.498908:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b00126fda00/0x72011f792b786a38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786a31 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.498915:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b00029c6a00/0x72011f792b786a46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786a3f expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.498921:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b00029c7000/0x72011f792b786a62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786a5b expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.498951:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b00029c6600/0x72011f792b786a8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786a85 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.498963:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b004217d400/0x72011f792b786a9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c0b expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.498971:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0001680a00/0x72011f792b786aa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c12 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.498981:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b00126fd800/0x72011f792b786ad9 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.499035:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0001680a00/0x72011f792b786aa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c12 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.499053:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0001680a00/0x72011f792b786aa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c12 expref: 9 pid: 5822 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201075.499072:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875064622440832:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788201075.499409:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b004217d400/0x72011f792b786a9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c0b expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.499418:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b004217d400/0x72011f792b786a9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c0b expref: 9 pid: 5822 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201075.499428:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c04000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875064622440960:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788201075.499463:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b00029c6600/0x72011f792b786a8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b786a85 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.499482:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b00029c6600/0x72011f792b786a8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b786a85 expref: 18 pid: 5819 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201075.499492:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c05c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875064622441088:0@lo:104: 00000100:00100000:3.0:1788201075.499540:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201075.499589:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b00029c7000/0x72011f792b786a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b786a5b expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.499607:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b00029c7000/0x72011f792b786a62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b786a5b expref: 18 pid: 5821 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201075.499616:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c05f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875064622441216:0@lo:104: 00000100:00100000:3.0:1788201075.499642:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201075.499754:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b00029c6a00/0x72011f792b786a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b786a3f expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.499762:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b00029c6a00/0x72011f792b786a46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b786a3f expref: 18 pid: 5819 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201075.499771:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c06680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875064622441344:0@lo:104: 00010000:00010000:3.0:1788201075.499796:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b00126fda00/0x72011f792b786a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b786a31 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.499804:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b00126fda00/0x72011f792b786a38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b786a31 expref: 18 pid: 5822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201075.499812:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c05500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875064622441472:0@lo:104: 00010000:00010000:3.0:1788201075.499847:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b00126fd200/0x72011f792b786a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b786a23 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.499861:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b00126fd200/0x72011f792b786a2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b786a23 expref: 18 pid: 5819 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201075.499870:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c06300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875064622441600:0@lo:104: 00010000:00010000:3.0:1788201075.499898:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0001681400/0x72011f792b786a00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b7869f9 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.499907:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b0001681400/0x72011f792b786a00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b7869f9 expref: 18 pid: 5822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201075.499914:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c06a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875064622441728:0@lo:104: 00010000:00010000:3.0:1788201075.499937:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0000030800/0x72011f792b7869d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b7869cf expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.499945:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b0000030800/0x72011f792b7869d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b7869cf expref: 18 pid: 5822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201075.499952:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c06d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875064622441856:0@lo:104: 00000100:00100000:3.0:1788201075.499971:0:8445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010a09840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201075.500564:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788201075.500589:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201075.500616:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201075.500628:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201075.500639:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201075.500648:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201075.500684:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622441088 00000100:00100000:0.0:1788201075.500692:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622441088 00000100:00100000:0.0:1788201075.500793:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622441216 00000100:00100000:0.0:1788201075.500798:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622441216 00000100:00100000:0.0:1788201075.500810:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622441344 00000100:00100000:0.0:1788201075.500812:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622441344 00000100:00100000:0.0:1788201075.500889:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622441472 00000100:00100000:0.0:1788201075.500893:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622441472 00000100:00100000:0.0:1788201075.500903:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622441600 00000100:00100000:0.0:1788201075.500906:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622441600 00000100:00100000:0.0:1788201075.500915:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622441728 00000100:00100000:0.0:1788201075.500917:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622441728 00000100:00100000:0.0:1788201075.500927:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622441856 00000100:00100000:0.0:1788201075.500929:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622441856 00000100:00100000:0.0:1788201075.500943:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201075.500953:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+9:8445:x1875064622441088:12345-0@lo:104: 00010000:00010000:0.0:1788201075.500972:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b00029c7e00/0x72011f792b786a85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786a8c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.501120:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201075.501127:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+9:8445:x1875064622441088:12345-0@lo:104: Request processed in 175us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201075.501155:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201075.501176:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201075.501182:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040453050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+8:8445:x1875064622441216:12345-0@lo:104: 00010000:00010000:0.0:1788201075.501191:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786a62 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.501224:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788201075.501229:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040453050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+8:8445:x1875064622441216:12345-0@lo:104: Request processed in 48us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201075.501244:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201075.501282:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201075.501288:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003593b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+7:8445:x1875064622441344:12345-0@lo:104: 00010000:00010000:0.0:1788201075.501295:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b00029c7a00/0x72011f792b786a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786a46 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.501323:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788201075.501328:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003593b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+7:8445:x1875064622441344:12345-0@lo:104: Request processed in 41us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201075.501334:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201075.501344:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201075.501350:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003593b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+6:8445:x1875064622441472:12345-0@lo:104: 00010000:00010000:0.0:1788201075.501357:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b00029c6000/0x72011f792b786a31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786a38 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.501384:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788201075.501389:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003593b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+6:8445:x1875064622441472:12345-0@lo:104: Request processed in 40us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201075.501394:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201075.501405:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201075.501411:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003593b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+5:8445:x1875064622441600:12345-0@lo:104: 00010000:00010000:0.0:1788201075.501419:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786a2a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.501445:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788201075.501450:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003593b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+5:8445:x1875064622441600:12345-0@lo:104: Request processed in 40us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201075.501461:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201075.501472:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201075.501478:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035938380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+4:8445:x1875064622441728:12345-0@lo:104: 00010000:00010000:0.0:1788201075.501485:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b7869f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786a00 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.501513:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788201075.501517:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035938380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+4:8445:x1875064622441728:12345-0@lo:104: Request processed in 40us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201075.501522:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201075.501534:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201075.501541:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+3:8445:x1875064622441856:12345-0@lo:104: 00010000:00010000:0.0:1788201075.501548:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b7869cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b7869d6 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.501573:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788201075.501577:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+3:8445:x1875064622441856:12345-0@lo:104: Request processed in 38us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201075.501582:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788201075.501613:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788201075.501620:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b00029c7e00/0x72011f792b786a85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786a8c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.501628:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7e00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1788201075.501633:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b00029c7e00/0x72011f792b786a85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b786a8c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.501654:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b00029c7e00/0x72011f792b786a85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b786a8c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201075.501662:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b00029c7e00/0x72011f792b786a85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b786a8c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201075.501668:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201075.501706:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b00029c7e00/0x72011f792b786a85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786a8c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.501713:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201075.501854:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00000100:00100000:1.0:1788201075.502099:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622441984:0@lo:103: 00000100:00100000:1.0:1788201075.502157:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201075.502248:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b00029c7e00/0x72011f792b786a85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786a8c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.502258:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b00029c7e00/0x72011f792b786a85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786a8c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.502275:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788201075.502278:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b00029c7a00/0x72011f792b786a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786a46 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.502284:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7a00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1788201075.502288:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b00029c7a00/0x72011f792b786a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b786a46 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.502295:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b00029c7a00/0x72011f792b786a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b786a46 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201075.502302:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b00029c7a00/0x72011f792b786a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b786a46 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201075.502314:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201075.502330:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b00029c7a00/0x72011f792b786a3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786a46 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.502336:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201075.502350:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b00029c7a00/0x72011f792b786a3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786a46 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.502358:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b00029c7a00/0x72011f792b786a3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786a46 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.502367:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201075.502371:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b00029c6000/0x72011f792b786a31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786a38 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.502377:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1788201075.502379:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b00029c6000/0x72011f792b786a31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b786a38 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.502386:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b00029c6000/0x72011f792b786a31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b786a38 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201075.502393:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b00029c6000/0x72011f792b786a31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b786a38 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201075.502398:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201075.502410:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b00029c6000/0x72011f792b786a31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786a38 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.502416:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201075.502427:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b00029c6000/0x72011f792b786a31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786a38 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.502434:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b00029c6000/0x72011f792b786a31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786a38 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.502445:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201075.502447:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786a2a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.502453:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681200 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1788201075.502456:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b786a2a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.502462:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b786a2a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201075.502468:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b786a2a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201075.502474:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201075.502487:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786a23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786a2a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.502493:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788201075.502731:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c05c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875064622441088:0@lo:104: 00000100:00100000:3.0:1788201075.502746:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c05f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875064622441216:0@lo:104: 00000100:00100000:3.0:1788201075.502754:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c06680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875064622441344:0@lo:104: 00000100:00100000:3.0:1788201075.502763:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c05500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875064622441472:0@lo:104: 00000100:00100000:3.0:1788201075.502771:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c06300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875064622441600:0@lo:104: 00000100:00100000:3.0:1788201075.502779:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c06a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875064622441728:0@lo:104: 00000100:00100000:3.0:1788201075.502787:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c06d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875064622441856:0@lo:104: 00010000:00010000:3.0:1788201075.503389:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201075.503434:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786a62 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.503445:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000031800 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1788201075.503448:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b786a62 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.503458:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b786a62 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201075.503475:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b786a62 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201075.503482:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201075.503505:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786a5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786a62 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.503511:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788201075.503593:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622442496:0@lo:103: 00000100:00100000:1.0:1788201075.503654:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201075.503685:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201075.503691:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622442368:0@lo:103: 00000100:00100000:1.0:1788201075.503709:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201075.503807:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622441984 00000100:00100000:1.0:1788201075.503813:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622441984 00010000:00010000:1.0:1788201075.503851:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b00029c6600/0x72011f792b786a8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786a85 expref: 19 pid: 5819 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201075.503878:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622442496 00000100:00100000:1.0:1788201075.503881:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622442496 00010000:00010000:1.0:1788201075.503892:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b00029c7000/0x72011f792b786a62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786a5b expref: 20 pid: 5821 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201075.503903:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622442368 00000100:00100000:1.0:1788201075.503906:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622442368 00010000:00010000:1.0:1788201075.503917:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b00126fd200/0x72011f792b786a2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786a23 expref: 21 pid: 5819 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201075.503929:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201075.503937:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027574000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+21:3293:x1875064622441984:12345-0@lo:103: 00010000:00010000:1.0:1788201075.503950:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201075.503956:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b00029c6600/0x72011f792b786a8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786a85 expref: 21 pid: 5819 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201075.503979:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b00029c6600/0x72011f792b786a8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b786a85 expref: 21 pid: 5819 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201075.503996:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00029c6600/0x72011f792b786a8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b786a85 expref: 21 pid: 5819 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201075.504021:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201075.504056:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027574000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+20:3293:x1875064622441984:12345-0@lo:103: Request processed in 118us (1897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201075.504063:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201075.504081:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201075.504088:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027575c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622442496:12345-0@lo:103: 00010000:00010000:1.0:1788201075.504095:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201075.504099:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b00029c7000/0x72011f792b786a62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786a5b expref: 19 pid: 5821 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201075.504107:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b00029c7000/0x72011f792b786a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b786a5b expref: 19 pid: 5821 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201075.504116:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00029c7000/0x72011f792b786a62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b786a5b expref: 19 pid: 5821 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201075.504124:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201075.504179:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027575c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+18:3293:x1875064622442496:12345-0@lo:103: Request processed in 92us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201075.504186:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201075.504198:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201075.504204:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+17:3293:x1875064622442368:12345-0@lo:103: 00010000:00010000:1.0:1788201075.504211:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201075.504215:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b00126fd200/0x72011f792b786a2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786a23 expref: 17 pid: 5819 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201075.504224:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b00126fd200/0x72011f792b786a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b786a23 expref: 17 pid: 5819 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201075.504242:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00126fd200/0x72011f792b786a2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b786a23 expref: 17 pid: 5819 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201075.504252:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201075.504271:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+16:3293:x1875064622442368:12345-0@lo:103: Request processed in 68us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201075.504277:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201075.504319:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622442368:0@lo:103: 00000100:00100000:1.0:1788201075.504328:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622442496:0@lo:103: 00000100:00100000:1.0:1788201075.504334:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622441984:0@lo:103: 00000100:00100000:3.0:1788201075.504666:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875064622440832:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201075.504676:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c04000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875064622440960:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788201075.504713:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b00126fd800/0x72011f792b786ad9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.504828:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786a23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786a2a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.504837:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786a23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786a2a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.504865:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201075.504877:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b7869cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b7869d6 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.504885:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000031000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1788201075.504888:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b7869cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b7869d6 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.504897:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b7869cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b7869d6 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201075.504904:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b7869cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b7869d6 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201075.504910:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201075.504932:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b7869cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b7869d6 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.504939:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201075.504945:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b7869cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b7869d6 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.504952:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b7869cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b7869d6 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.504972:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201075.504974:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201075.504976:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201075.505008:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622442112:0@lo:103: 00000100:00100000:0.0:1788201075.505043:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201075.505070:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622442624:0@lo:103: 00000100:00100000:0.0:1788201075.505100:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201075.505116:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201075.505122:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622442240:0@lo:103: 00000100:00100000:0.0:1788201075.505162:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201075.505191:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622442112 00000100:00100000:0.0:1788201075.505195:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622442112 00010000:00010000:0.0:1788201075.505216:0:6691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b00029c6a00/0x72011f792b786a46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786a3f expref: 16 pid: 5819 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201075.505233:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622442624 00000100:00100000:0.0:1788201075.505235:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622442624 00010000:00010000:0.0:1788201075.505245:0:6691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0000030800/0x72011f792b7869d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b7869cf expref: 17 pid: 5822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201075.505255:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622442240 00000100:00100000:0.0:1788201075.505257:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622442240 00010000:00010000:0.0:1788201075.505266:0:6691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b00126fda00/0x72011f792b786a38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786a31 expref: 18 pid: 5822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201075.505276:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201075.505281:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16f590af-689d-4459-b486-809c9db65822+18:3294:x1875064622442112:12345-0@lo:103: 00010000:00010000:0.0:1788201075.505290:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201075.505295:0:6691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b00029c6a00/0x72011f792b786a46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786a3f expref: 18 pid: 5819 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.505303:0:6691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b00029c6a00/0x72011f792b786a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b786a3f expref: 18 pid: 5819 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.505315:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00029c6a00/0x72011f792b786a46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b786a3f expref: 18 pid: 5819 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.505336:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201075.505364:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16f590af-689d-4459-b486-809c9db65822+17:3294:x1875064622442112:12345-0@lo:103: Request processed in 83us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201075.505371:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201075.505400:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201075.505406:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16f590af-689d-4459-b486-809c9db65822+16:3294:x1875064622442624:12345-0@lo:103: 00010000:00010000:0.0:1788201075.505413:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201075.505417:0:6691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0000030800/0x72011f792b7869d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b7869cf expref: 16 pid: 5822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.505426:0:6691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0000030800/0x72011f792b7869d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b7869cf expref: 16 pid: 5822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.505436:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0000030800/0x72011f792b7869d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b7869cf expref: 16 pid: 5822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.505446:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201075.505468:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16f590af-689d-4459-b486-809c9db65822+15:3294:x1875064622442624:12345-0@lo:103: Request processed in 62us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201075.505474:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201075.505484:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201075.505490:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035938700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16f590af-689d-4459-b486-809c9db65822+14:3294:x1875064622442240:12345-0@lo:103: 00010000:00010000:0.0:1788201075.505497:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201075.505501:0:6691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b00126fda00/0x72011f792b786a38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786a31 expref: 14 pid: 5822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.505509:0:6691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b00126fda00/0x72011f792b786a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b786a31 expref: 14 pid: 5822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.505524:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00126fda00/0x72011f792b786a38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b786a31 expref: 14 pid: 5822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.505533:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201075.505555:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035938700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16f590af-689d-4459-b486-809c9db65822+13:3294:x1875064622442240:12345-0@lo:103: Request processed in 65us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201075.505560:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201075.505699:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622442240:0@lo:103: 00000100:00100000:0.0:1788201075.505707:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622442112:0@lo:103: 00000100:00100000:0.0:1788201075.505713:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622442624:0@lo:103: 00000100:00100000:0.0:1788201075.506781:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201075.506882:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201075.506912:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614031360 00000100:00100000:0.0:1788201075.506919:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614031360 00010000:00010000:0.0:1788201075.506950:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0001680a00/0x72011f792b786aa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c12 expref: 10 pid: 5822 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201075.507034:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614031488 00000100:00100000:0.0:1788201075.507038:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614031488 00010000:00010000:0.0:1788201075.507051:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b004217d400/0x72011f792b786a9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c0b expref: 11 pid: 5822 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201075.507071:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:0.0:1788201075.507079:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006798050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79fcbf4-8d24-427b-827f-6b1cb026b088+11:2349:x1875064614031360:12345-192.168.203.14@tcp:103: 00010000:00010000:0.0:1788201075.507092:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201075.507097:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0001680a00/0x72011f792b786aa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c12 expref: 11 pid: 5822 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.507121:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0001680a00/0x72011f792b786aa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c12 expref: 11 pid: 5822 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.507158:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0001680a00/0x72011f792b786aa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c12 expref: 11 pid: 5822 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.507174:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201075.507226:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006798050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2349:x1875064614031360:12345-192.168.203.14@tcp:103: Request processed in 147us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201075.507233:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:0.0:1788201075.507277:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:0.0:1788201075.507284:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035939f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79fcbf4-8d24-427b-827f-6b1cb026b088+9:2349:x1875064614031488:12345-192.168.203.14@tcp:103: 00010000:00010000:0.0:1788201075.507292:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201075.507296:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b004217d400/0x72011f792b786a9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c0b expref: 9 pid: 5822 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.507306:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b004217d400/0x72011f792b786a9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c0b expref: 9 pid: 5822 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.507317:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b004217d400/0x72011f792b786a9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c0b expref: 9 pid: 5822 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.507329:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201075.507347:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035939f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79fcbf4-8d24-427b-827f-6b1cb026b088+8:2349:x1875064614031488:12345-192.168.203.14@tcp:103: Request processed in 64us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201075.507354:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00010000:00010000:2.0:1788201075.507939:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786a5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786a62 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.507951:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b786a5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786a62 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.507974:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201075.507976:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201075.507978:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201075.508402:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201075.508412:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201075.508414:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201075.508446:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b7869f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786a00 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.508455:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fd000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1788201075.508458:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b7869f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b786a00 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.508468:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b7869f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b786a00 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201075.508476:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b7869f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b786a00 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201075.508493:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201075.508542:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b7869f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786a00 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.508550:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201075.508572:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b7869f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786a00 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.508579:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b7869f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786a00 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201075.508619:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622442752:0@lo:103: 00000100:00100000:2.0:1788201075.508675:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201075.508735:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622442752 00000100:00100000:2.0:1788201075.508741:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622442752 00010000:00010000:2.0:1788201075.508765:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0001681400/0x72011f792b786a00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b7869f9 expref: 13 pid: 5822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201075.508789:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201075.508797:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+13:3295:x1875064622442752:12345-0@lo:103: 00010000:00010000:2.0:1788201075.508808:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201075.508813:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0001681400/0x72011f792b786a00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b7869f9 expref: 13 pid: 5822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.508934:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0001681400/0x72011f792b786a00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b7869f9 expref: 13 pid: 5822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.508948:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0001681400/0x72011f792b786a00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b7869f9 expref: 13 pid: 5822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.508976:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b00126fd800/0x72011f792b786ad9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.508985:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00126fd800/0x72011f792b786ad9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.509002:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b00126fd800/0x72011f792b786ad9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.509010:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b00126fd800/0x72011f792b786ad9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.509018:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b00126fd800/0x72011f792b786ad9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.509025:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b00126fd800/0x72011f792b786ad9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.509031:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fd800 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:2.0:1788201075.509036:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b00126fd800/0x72011f792b786ad9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.509043:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b00126fd800/0x72011f792b786ad9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.509393:0:8445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b00126fd800/0x72011f792b786ad9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201075.509402:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b00126fd800/0x72011f792b786ad9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.510274:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201075.510279:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201075.510283:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201075.510793:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b00126fd800/0x72011f792b786ad9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.510810:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00126fd800/0x72011f792b786ad9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.510856:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201075.510953:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+12:3295:x1875064622442752:12345-0@lo:103: Request processed in 2152us (2274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201075.511127:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622442752:0@lo:103: 00000100:00100000:2.0:1788201075.511211:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788201075.722953:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201075.723275:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614031616 00000100:00100000:2.0:1788201075.723288:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614031616 00000100:00100000:2.0:1788201075.723570:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 129 00000100:00100000:2.0:1788201075.723583:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000506b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+8:5588:x1875064614031616:12345-192.168.203.14@tcp:101: 00010000:00010000:2.0:1788201075.723615:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201075.723640:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b001f8f1400/0x72011f792b786ae0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2c74 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.723686:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b001f8f1400/0x72011f792b786ae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c74 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.723699:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b001f8f1400/0x72011f792b786ae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c74 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201075.723710:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1400, rc 0) 00000100:00100000:2.0:1788201075.723788:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000506b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+9:5588:x1875064614031616:12345-192.168.203.14@tcp:101: Request processed in 208us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201075.723795:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 129 00000100:00100000:0.0:1788201075.725535:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201075.728279:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614031744 00000100:00100000:2.0:1788201075.728298:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614031744 00000100:00100000:2.0:1788201075.728366:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 130 00000100:00100000:2.0:1788201075.728562:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000506a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+9:5588:x1875064614031744:12345-192.168.203.14@tcp:501: 00000100:00100000:2.0:1788201075.729192:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000506a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+9:5588:x1875064614031744:12345-192.168.203.14@tcp:501: Request processed in 812us (3662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201075.729565:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 130 00000100:00100000:0.0:1788201075.732459:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201075.732539:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614031872 00000100:00100000:2.0:1788201075.732550:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614031872 00000100:00100000:2.0:1788201075.732619:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 131 00000100:00100000:2.0:1788201075.732630:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005069850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+9:5588:x1875064614031872:12345-192.168.203.14@tcp:503: 00000100:00100000:2.0:1788201075.733338:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005069850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+9:5588:x1875064614031872:12345-192.168.203.14@tcp:503: Request processed in 707us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201075.733347:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 131 00000100:00100000:0.0:1788201075.737338:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201075.737489:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614032000 00000100:00100000:3.0:1788201075.737501:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614032000 00000100:00100000:3.0:1788201075.737613:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 132 00000100:00100000:3.0:1788201075.737625:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+9:6055:x1875064614032000:12345-192.168.203.14@tcp:502: 00000100:00100000:3.0:1788201075.738317:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+9:6055:x1875064614032000:12345-192.168.203.14@tcp:502: Request processed in 692us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201075.738327:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 132 00000100:00100000:0.0:1788201075.740936:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201075.741365:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614032128 00000100:00100000:2.0:1788201075.741376:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614032128 00000100:00100000:2.0:1788201075.741528:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 133 00000100:00100000:2.0:1788201075.741539:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+9:6055:x1875064614032128:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201075.741918:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+9:6055:x1875064614032128:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 380us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201075.741927:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 133 00000100:00100000:0.0:1788201075.745100:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201075.745296:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614032256 00000100:00100000:3.0:1788201075.745309:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614032256 00000100:00100000:3.0:1788201075.745378:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 134 00000100:00100000:3.0:1788201075.745391:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+9:5588:x1875064614032256:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201075.745423:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201075.745447:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b00126fc600/0x72011f792b786ae7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2c7b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.745484:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00126fc600/0x72011f792b786ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c7b expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.745497:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b00126fc600/0x72011f792b786ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c7b expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201075.745521:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fc600, rc 0) 00000100:00100000:3.0:1788201075.745593:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:5588:x1875064614032256:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 Request processed in 204us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201075.745609:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 134 00000100:00100000:0.0:1788201075.748245:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201075.748359:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614032384 00000100:00100000:1.0:1788201075.748370:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614032384 00000100:00100000:1.0:1788201075.748449:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 135 00000100:00100000:1.0:1788201075.748461:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:5588:x1875064614032384:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201075.749180:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:5588:x1875064614032384:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 Request processed in 720us (947us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201075.749190:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 135 00010000:00010000:0.0:1788201076.171420:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201077.020218:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201077.020253:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201077.020270:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201077.020293:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201077.020397:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614032640 00000100:00100000:3.0:1788201077.020407:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614032640 00000100:00100000:3.0:1788201077.020488:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:3.0:1788201077.020498:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2351:x1875064614032640:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201077.020568:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2351:x1875064614032640:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 73us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201077.020576:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:1.0:1788201077.020617:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614032768 00000100:00100000:1.0:1788201077.020623:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614032768 00000100:00100000:1.0:1788201077.020655:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614032896 00000100:00100000:1.0:1788201077.020658:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614032896 00000100:00100000:1.0:1788201077.020684:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:1.0:1788201077.020693:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2351:x1875064614032768:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201077.020700:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:3.0:1788201077.020711:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2351:x1875064614032896:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201077.020737:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2351:x1875064614032768:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 45us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201077.020743:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2351:x1875064614032896:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 33us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201077.020749:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:1.0:1788201077.020762:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00080000:0.0:1788201077.020831:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201077.020836:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201077.020838:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201077.021196:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614032512 00000100:00100000:2.0:1788201077.021201:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614032512 00000100:00100000:2.0:1788201077.021235:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 136 00000100:00100000:2.0:1788201077.021243:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2351:x1875064614032512:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201077.021336:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2351:x1875064614032512:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 93us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201077.021343:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 136 10000000:01000000:2.0:1788201077.134920:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788201077.134928:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b003f8e9800 from 39 10000000:01000000:2.0:1788201077.134933:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201077.134999:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1e00/0x72011f792b786aee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.135012:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1e00/0x72011f792b786aee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.135023:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1e00/0x72011f792b786aee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201077.135046:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622442880:0@lo:101: 00000100:00100000:2.0:1788201077.135109:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201077.135184:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f42a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201077.135246:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622442880 00000100:00100000:3.0:1788201077.135253:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622442880 00000100:00100000:3.0:1788201077.135305:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788201077.135314:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+12:5825:x1875064622442880:12345-0@lo:101: 00010000:00010000:3.0:1788201077.135326:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201077.135338:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b00126fca00/0x72011f792b786af5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786aee expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.135372:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00126fca00/0x72011f792b786af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786aee expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.135382:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b00126fca00/0x72011f792b786af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786aee expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.135391:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fca00, rc 0) 00000100:00100000:3.0:1788201077.135434:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:5825:x1875064622442880:12345-0@lo:101: Request processed in 121us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201077.135440:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788201077.136264:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622442880:0@lo:101: 00010000:00010000:0.0:1788201077.136281:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1e00/0x72011f792b786aee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786af5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.136290:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1e00/0x72011f792b786aee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786af5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201077.136372:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622443008:0@lo:501: 00000100:00100000:0.0:1788201077.136404:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201077.136441:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003b3bae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201077.136484:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622443008 00000100:00100000:3.0:1788201077.136489:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622443008 00000100:00100000:3.0:1788201077.136530:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788201077.136537:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+13:5825:x1875064622443008:12345-0@lo:501: 00000100:00100000:3.0:1788201077.136804:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+13:5825:x1875064622443008:12345-0@lo:501: Request processed in 266us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201077.136811:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788201077.136928:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622443008:0@lo:501: 00000100:00100000:2.0:1788201077.136956:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622443136:0@lo:503: 00000100:00100000:2.0:1788201077.137005:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201077.137026:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f42a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201077.137311:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622443136 00000100:00100000:0.0:1788201077.137316:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622443136 00000100:00100000:0.0:1788201077.137352:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788201077.137360:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:5825:x1875064622443136:12345-0@lo:503: 00000100:00100000:0.0:1788201077.137507:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+13:5825:x1875064622443136:12345-0@lo:503: Request processed in 147us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201077.137514:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788201077.137637:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622443136:0@lo:503: 00000100:00100000:2.0:1788201077.137808:0:8472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8472:1875064622443264:0@lo:502: 00000100:00100000:2.0:1788201077.137844:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201077.142359:0:8472:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f42a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201077.145286:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622443264 00000100:00100000:3.0:1788201077.145311:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622443264 00000100:00100000:3.0:1788201077.145376:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788201077.145480:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+13:8472:x1875064622443264:12345-0@lo:502: 00000100:00100000:3.0:1788201077.146128:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+13:8472:x1875064622443264:12345-0@lo:502: Request processed in 651us (8281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201077.146163:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788201077.147809:0:8472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8472:1875064622443264:0@lo:502: 00000100:00100000:1.0:1788201077.147890:0:8472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027575f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8472:1875064622443392:0@lo:502: 00000100:00100000:1.0:1788201077.147949:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201077.147982:0:8472:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201077.148451:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622443392 00000100:00100000:3.0:1788201077.148459:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622443392 00000100:00100000:3.0:1788201077.148512:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788201077.148529:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+13:8472:x1875064622443392:12345-0@lo:502: 00000100:00100000:3.0:1788201077.148790:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+13:8472:x1875064622443392:12345-0@lo:502: Request processed in 263us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201077.148799:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788201077.149465:0:8472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027575f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8472:1875064622443392:0@lo:502: 00000040:00080000:1.0:1788201077.149493:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788201077.150508:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788201077.150537:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201077.150547:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1e00/0x72011f792b786aee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786af5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.150559:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1e00/0x72011f792b786aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786af5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201077.150569:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788201077.150572:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788201077.150576:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788201077.150621:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fc400/0x72011f792b786afc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.150629:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b00126fc400/0x72011f792b786afc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.150637:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b00126fc400/0x72011f792b786afc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201077.150657:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622443520:0@lo:101: 00000100:00100000:3.0:1788201077.150712:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201077.150762:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010a09600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201077.150888:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622443520 00000100:00100000:0.0:1788201077.150895:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622443520 00000100:00100000:0.0:1788201077.150946:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788201077.150964:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+13:5825:x1875064622443520:12345-0@lo:101: 00010000:00010000:0.0:1788201077.150977:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201077.150990:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b004217d800/0x72011f792b786b03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786afc expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.151014:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b004217d800/0x72011f792b786b03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786afc expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.151025:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b004217d800/0x72011f792b786b03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786afc expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.151034:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b004217d800, rc 0) 00000100:00100000:0.0:1788201077.151075:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+14:5825:x1875064622443520:12345-0@lo:101: Request processed in 120us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201077.151096:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788201077.153918:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622443520:0@lo:101: 00010000:00010000:3.0:1788201077.154017:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b00126fc400/0x72011f792b786afc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b03 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.156678:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b00126fc400/0x72011f792b786afc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786b03 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201077.156781:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622443648:0@lo:501: 00000100:00100000:3.0:1788201077.156844:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201077.156889:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010a09600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201077.159560:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622443648 00000100:00100000:0.0:1788201077.159573:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622443648 00000100:00100000:0.0:1788201077.159642:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788201077.159652:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+14:5825:x1875064622443648:12345-0@lo:501: 00000100:00100000:0.0:1788201077.159970:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+14:5825:x1875064622443648:12345-0@lo:501: Request processed in 318us (3124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201077.159978:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788201077.160114:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622443648:0@lo:501: 00000100:00100000:1.0:1788201077.160198:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027575f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622443776:0@lo:503: 00000100:00100000:1.0:1788201077.160248:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201077.160278:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201077.160472:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622443776 00000100:00100000:3.0:1788201077.160477:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622443776 00000100:00100000:3.0:1788201077.160515:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788201077.160522:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+14:5825:x1875064622443776:12345-0@lo:503: 00000100:00100000:3.0:1788201077.160684:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+14:5825:x1875064622443776:12345-0@lo:503: Request processed in 162us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201077.160691:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788201077.160942:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027575f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622443776:0@lo:503: 00000100:00100000:1.0:1788201077.167286:0:8474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027575f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8474:1875064622443904:0@lo:502: 00000100:00100000:1.0:1788201077.167388:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201077.167441:0:8474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201077.167477:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622443904 00000100:00100000:0.0:1788201077.167486:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622443904 00000100:00100000:0.0:1788201077.167540:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788201077.167549:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+14:8474:x1875064622443904:12345-0@lo:502: 00000100:00100000:2.0:1788201077.180320:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+14:8474:x1875064622443904:12345-0@lo:502: Request processed in 12764us (12937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201077.180333:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788201077.180889:0:8474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027575f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8474:1875064622443904:0@lo:502: 00000020:01000000:0.0:1788201077.180925:0:8474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201077.180935:0:8474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201077.180937:0:8474:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788201077.180943:0:8474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788201077.180995:0:8474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8474:1875064622444032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201077.181049:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201077.181089:0:8474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003b3ba6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201077.181266:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622444032 00000100:00100000:0.0:1788201077.181273:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622444032 00000100:00100000:0.0:1788201077.181320:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788201077.181329:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+14:8474:x1875064622444032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201077.181515:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+14:8474:x1875064622444032:12345-0@lo:502:llog_process_th.0 Request processed in 186us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201077.181533:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788201077.181573:0:8474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8474:1875064622444032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201077.181613:0:8474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201077.181617:0:8474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201077.181619:0:8474:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788201077.181623:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788201077.181674:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788201077.181691:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788201077.181701:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fc400/0x72011f792b786afc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b03 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.181712:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b00126fc400/0x72011f792b786afc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b03 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201077.181722:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788201077.181726:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b0010346000 from 39 10000000:01000000:0.0:1788201077.181729:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201077.181754:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b004217ce00/0x72011f792b786b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.181762:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b004217ce00/0x72011f792b786b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.181906:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b004217ce00/0x72011f792b786b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201077.181922:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622444160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201077.182452:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201077.182494:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8e4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201077.182526:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622444160 00000100:00100000:1.0:1788201077.182534:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622444160 00000100:00100000:1.0:1788201077.182579:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788201077.182598:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+14:5825:x1875064622444160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201077.182610:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201077.182625:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0001680a00/0x72011f792b786b11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786b0a expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201077.182649:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0001680a00/0x72011f792b786b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786b0a expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201077.182668:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0001680a00/0x72011f792b786b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786b0a expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201077.182678:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680a00, rc 0) 00000100:00100000:1.0:1788201077.182719:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+15:5825:x1875064622444160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201077.182725:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788201077.184504:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622444160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201077.184528:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b004217ce00/0x72011f792b786b0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b11 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.184540:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b004217ce00/0x72011f792b786b0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786b11 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201077.184617:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622444288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201077.184663:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201077.184697:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8e4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201077.184716:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622444288 00000100:00100000:0.0:1788201077.184721:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622444288 00000100:00100000:0.0:1788201077.184752:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788201077.184759:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+15:5825:x1875064622444288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201077.185755:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+15:5825:x1875064622444288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 994us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201077.185773:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788201077.186322:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622444288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201077.186370:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622444416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201077.186430:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201077.186457:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010a09600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201077.186815:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622444416 00000100:00100000:2.0:1788201077.186821:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622444416 00000100:00100000:2.0:1788201077.186896:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788201077.186907:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+15:5825:x1875064622444416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201077.187123:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+15:5825:x1875064622444416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201077.187155:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788201077.187240:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622444416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201077.187417:0:8477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8477:1875064622444544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201077.187457:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201077.187805:0:8477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010a099c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201077.187865:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622444544 00000100:00100000:0.0:1788201077.187869:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622444544 00000100:00100000:0.0:1788201077.187893:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788201077.187901:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+15:8477:x1875064622444544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201077.188285:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+15:8477:x1875064622444544:12345-0@lo:502:llog_process_th.0 Request processed in 384us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201077.188293:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788201077.188447:0:8477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8477:1875064622444544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201077.188484:0:8477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8477:1875064622444672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201077.188522:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201077.188580:0:8477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010a099c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201077.188619:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622444672 00000100:00100000:0.0:1788201077.188623:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622444672 00000100:00100000:0.0:1788201077.188686:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788201077.188693:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+15:8477:x1875064622444672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201077.188850:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+15:8477:x1875064622444672:12345-0@lo:502:llog_process_th.0 Request processed in 157us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201077.188857:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788201077.188912:0:8477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8477:1875064622444672:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788201077.188929:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788201077.188997:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788201077.189015:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201077.189023:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b004217ce00/0x72011f792b786b0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b11 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.189034:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b004217ce00/0x72011f792b786b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b11 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201077.189043:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788201077.189046:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788201077.189049:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788201077.189070:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fd800/0x72011f792b786b18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.189076:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b00126fd800/0x72011f792b786b18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.189086:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b00126fd800/0x72011f792b786b18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201077.189098:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622444800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201077.189125:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201077.189627:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010a099c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201077.189714:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622444800 00000100:00100000:0.0:1788201077.189719:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622444800 00000100:00100000:0.0:1788201077.189746:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788201077.189753:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+15:5825:x1875064622444800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201077.189763:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201077.189784:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b004217d400/0x72011f792b786b1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786b18 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.189805:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b004217d400/0x72011f792b786b1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786b18 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.189815:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b004217d400/0x72011f792b786b1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786b18 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.189825:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b004217d400, rc 0) 00000100:00100000:0.0:1788201077.189865:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+16:5825:x1875064622444800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201077.189870:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788201077.189979:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622444800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201077.190002:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b00126fd800/0x72011f792b786b18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b1f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.190011:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b00126fd800/0x72011f792b786b18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786b1f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201077.190068:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622444928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201077.190096:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201077.190108:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622444928 00000100:00100000:3.0:1788201077.190113:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010a099c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201077.190115:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622444928 00000100:00100000:1.0:1788201077.190158:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788201077.190166:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:5825:x1875064622444928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201077.190413:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:5825:x1875064622444928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201077.190421:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788201077.190506:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622444928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201077.190532:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622445056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201077.190565:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201077.190600:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010a099c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201077.190612:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622445056 00000100:00100000:3.0:1788201077.190616:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622445056 00000100:00100000:3.0:1788201077.190633:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788201077.190639:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:5825:x1875064622445056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201077.190786:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:5825:x1875064622445056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201077.190793:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788201077.190827:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622445056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201077.190992:0:8478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8478:1875064622445184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201077.191023:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201077.191041:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622445184 00000100:00100000:3.0:1788201077.191045:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622445184 00000100:00100000:3.0:1788201077.191066:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788201077.191071:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:8478:x1875064622445184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201077.191212:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:8478:x1875064622445184:12345-0@lo:502:llog_process_th.0 Request processed in 139us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201077.191218:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788201077.191247:0:8478:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010a09900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201077.191259:0:8478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8478:1875064622445184:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201077.191275:0:8478:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201077.191282:0:8478:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201077.191284:0:8478:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788201077.191289:0:8478:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788201077.191306:0:8478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8478:1875064622445312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201077.191336:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201077.191351:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622445312 00000100:00100000:3.0:1788201077.191355:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622445312 00000100:00100000:3.0:1788201077.191369:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788201077.191388:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:8478:x1875064622445312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201077.191489:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:8478:x1875064622445312:12345-0@lo:502:llog_process_th.0 Request processed in 114us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201077.191496:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788201077.191523:0:8478:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010a09900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201077.191534:0:8478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8478:1875064622445312:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201077.191549:0:8478:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201077.191552:0:8478:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201077.191554:0:8478:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788201077.191557:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788201077.191607:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788201077.191628:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788201077.191635:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fd800/0x72011f792b786b18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b1f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.191644:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b00126fd800/0x72011f792b786b18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b1f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201077.191652:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201077.191655:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b0007c1d000 from 39 10000000:01000000:3.0:1788201077.191657:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201077.191677:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b786b26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.191685:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b786b26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.191694:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b786b26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201077.191706:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622445440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201077.191742:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201077.191756:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010a09900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201077.191767:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622445440 00000100:00100000:3.0:1788201077.191770:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622445440 00000100:00100000:3.0:1788201077.191786:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788201077.191791:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+16:5825:x1875064622445440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201077.191798:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201077.191809:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b00126fd200/0x72011f792b786b2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786b26 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.191837:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00126fd200/0x72011f792b786b2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786b26 expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.191845:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b00126fd200/0x72011f792b786b2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786b26 expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.191853:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fd200, rc 0) 00000100:00100000:3.0:1788201077.191880:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622445440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201077.191886:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788201077.191913:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622445440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201077.191922:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b786b26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b2d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.191930:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b786b26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786b2d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201077.191964:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622445568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201077.191985:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201077.191996:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010a09900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201077.192005:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622445568 00000100:00100000:3.0:1788201077.192008:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622445568 00000100:00100000:3.0:1788201077.192022:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788201077.192028:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622445568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201077.192227:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622445568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201077.192242:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788201077.192273:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622445568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201077.192293:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622445696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201077.192337:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201077.192356:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8e4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201077.192366:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622445696 00000100:00100000:3.0:1788201077.192369:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622445696 00000100:00100000:3.0:1788201077.192383:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788201077.192388:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622445696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201077.192504:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622445696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201077.192510:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788201077.192540:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622445696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201077.197064:0:8479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8479:1875064622445824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201077.197158:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201077.197196:0:8479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0006315540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201077.197329:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622445824 00000100:00100000:3.0:1788201077.197335:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622445824 00000100:00100000:0.0:1788201077.197465:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788201077.197475:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+17:8479:x1875064622445824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201077.197733:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+17:8479:x1875064622445824:12345-0@lo:502:llog_process_th.0 Request processed in 259us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201077.197741:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788201077.197791:0:8479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8479:1875064622445824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201077.197838:0:8479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8479:1875064622445952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201077.197868:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201077.197888:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622445952 00000100:00100000:0.0:1788201077.197892:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622445952 00000100:00100000:0.0:1788201077.197910:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788201077.197916:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+17:8479:x1875064622445952:12345-0@lo:502:llog_process_th.0 00010000:00010000:2.0:1788201077.198105:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201077.198735:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+17:8479:x1875064622445952:12345-0@lo:502:llog_process_th.0 Request processed in 815us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201077.198743:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788201077.198787:0:8479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0006315540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201077.198803:0:8479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8479:1875064622445952:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788201077.198826:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788201077.206065:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788201077.206096:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201077.206108:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b786b26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b2d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.206120:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b786b26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b2d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201077.206251:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788201077.206256:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788201077.206259:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201077.206302:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0c00/0x72011f792b786b34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.206310:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0c00/0x72011f792b786b34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.206321:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0c00/0x72011f792b786b34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201077.206346:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622446080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201077.206426:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201077.206461:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f42a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201077.206622:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622446080 00000100:00100000:2.0:1788201077.206629:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622446080 00000100:00100000:2.0:1788201077.206679:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788201077.206688:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622446080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201077.206701:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201077.206714:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b001f8f0800/0x72011f792b786b3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786b34 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.206735:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b001f8f0800/0x72011f792b786b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786b34 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.206762:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b001f8f0800/0x72011f792b786b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786b34 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.206771:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0800, rc 0) 00000100:00100000:2.0:1788201077.206809:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622446080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201077.206816:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788201077.206858:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622446080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201077.206871:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0c00/0x72011f792b786b34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b3b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.206880:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0c00/0x72011f792b786b34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786b3b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201077.206925:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622446208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201077.206961:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201077.207107:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f42a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201077.207121:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622446208 00000100:00100000:2.0:1788201077.207124:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622446208 00000100:00100000:2.0:1788201077.207170:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788201077.207176:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622446208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201077.207479:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622446208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201077.207486:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788201077.207518:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622446208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201077.207553:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622446336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201077.214691:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201077.214801:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f42a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201077.215811:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622446336 00000100:00100000:0.0:1788201077.215823:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622446336 00000100:00100000:0.0:1788201077.215881:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788201077.215894:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622446336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201077.217112:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622446336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1216us (2422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201077.217122:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788201077.218020:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622446336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201077.218389:0:8481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8481:1875064622446464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201077.218564:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201077.218616:0:8481:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0006315600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201077.218672:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622446464 00000100:00100000:2.0:1788201077.218679:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622446464 00000100:00100000:2.0:1788201077.218724:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788201077.218734:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+18:8481:x1875064622446464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201077.219087:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+18:8481:x1875064622446464:12345-0@lo:502:llog_process_th.0 Request processed in 354us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201077.219095:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788201077.219187:0:8481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8481:1875064622446464:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201077.219210:0:8481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201077.219218:0:8481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201077.219220:0:8481:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788201077.219225:0:8481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788201077.219244:0:8481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8481:1875064622446592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201077.219274:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201077.219296:0:8481:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0006315600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201077.219352:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622446592 00000100:00100000:2.0:1788201077.219357:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622446592 00000100:00100000:2.0:1788201077.219439:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788201077.219504:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:8481:x1875064622446592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201077.219646:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:8481:x1875064622446592:12345-0@lo:502:llog_process_th.0 Request processed in 200us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201077.219653:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788201077.219939:0:8481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8481:1875064622446592:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201077.219958:0:8481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201077.219962:0:8481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201077.219964:0:8481:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788201077.219967:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788201077.220719:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1788201077.220746:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788201077.220757:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0c00/0x72011f792b786b34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b3b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201077.220767:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0c00/0x72011f792b786b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b3b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201077.220777:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788201077.220780:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b000701cd40 from 1 10000000:01000000:1.0:1788201077.220783:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788201077.220817:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786b42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201077.220911:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786b42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201077.220922:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786b42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201077.220941:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027576680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622446720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201077.220985:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201077.221562:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201077.222645:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622446720 00000100:00100000:0.0:1788201077.222655:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622446720 00000100:00100000:0.0:1788201077.222720:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788201077.222730:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622446720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201077.222745:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201077.222762:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b004217ca00/0x72011f792b786b49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786b42 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.222790:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b004217ca00/0x72011f792b786b49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786b42 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.222801:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b004217ca00/0x72011f792b786b49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786b42 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.222837:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b004217ca00, rc 0) 00000100:00100000:0.0:1788201077.222907:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622446720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (1921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201077.222915:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788201077.222945:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027576680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622446720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201077.222963:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786b42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b49 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201077.222973:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786b42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786b49 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201077.223039:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027576680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622446848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201077.223076:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201077.223100:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201077.225618:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622446848 00000100:00100000:2.0:1788201077.225630:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622446848 00000100:00100000:2.0:1788201077.225683:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788201077.225694:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622446848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201077.226210:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622446848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 515us (3130us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201077.226218:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788201077.226486:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027576680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622446848:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788201077.226525:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788201077.226535:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786b42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b49 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201077.226545:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b49 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201077.519518:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622446976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201077.519598:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201077.519717:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622446976 00000100:00100000:2.0:1788201077.519725:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622446976 00000100:00100000:2.0:1788201077.519790:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201077.519801:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622446976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201077.519833:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201077.519880:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622446976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201077.519886:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788201077.519923:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0005136d80 x1875064622446976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201077.519940:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622446976:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788201077.519990:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201077.521973:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f614700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622447232:0@lo:400:kworker.0 00000100:00100000:2.0:1788201077.522030:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201077.522064:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201077.522070:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622447360:0@lo:400:kworker.0 00000100:00100000:2.0:1788201077.522095:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201077.522128:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622447232 00000100:00100000:2.0:1788201077.522164:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622447232 00000100:00100000:2.0:1788201077.522215:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788201077.522224:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622447232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201077.522273:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622447232:12345-0@lo:400:kworker.0 Request processed in 51us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201077.522280:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788201077.522299:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622447360 00000100:00100000:2.0:1788201077.522302:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622447360 00000100:00100000:2.0:1788201077.522327:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201077.522332:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622447360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201077.522484:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622447104:0@lo:400:kworker.0 00000100:00100000:1.0:1788201077.522516:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201077.522537:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201077.522542:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622447488:0@lo:400:kworker.0 00000100:00100000:1.0:1788201077.522561:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201077.522599:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622447104 00000100:00100000:1.0:1788201077.522604:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622447104 00000100:00100000:1.0:1788201077.522619:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622447488 00000100:00100000:1.0:1788201077.522621:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622447488 00000100:00100000:1.0:1788201077.522634:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201077.522641:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622447104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201077.522675:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622447104:12345-0@lo:400:kworker.0 Request processed in 35us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201077.522680:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201077.522693:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201077.522699:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622447488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201077.522726:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622447488:12345-0@lo:400:kworker.0 Request processed in 27us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201077.522731:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201077.522763:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622447488:0@lo:400:kworker.0 00000100:00100000:1.0:1788201077.522772:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622447104:0@lo:400:kworker.0 00000100:00100000:2.0:1788201077.522865:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622447360:12345-0@lo:400:kworker.0 Request processed in 39us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201077.522873:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788201077.522894:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201077.522898:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788201077.522931:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b003f616300 x1875064622447360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201077.522941:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622447360:0@lo:400:kworker.0 00000100:00100000:2.0:1788201077.522951:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f614700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622447232:0@lo:400:kworker.0 00000020:00000080:3.0:1788201077.647258:0:8506:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe48c3ce70 20000000:00000080:3.0:1788201077.647274:0:8506:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b003f4abc00 uarg=0000000000000000 20000000:01000000:3.0:1788201077.647307:0:8506:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788201077.647313:0:8506:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788201077.647317:0:8506:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788201077.650061:0:8507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788201077.650406:0:8506:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788201077.665508:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788201077.665566:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788201077.665640:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788201077.665657:0:8506:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788201077.665674:0:8506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b001f8f1c00/0x72011f792b786b50 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.665692:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0001680000/0x72011f792b7868c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b7868be expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.665699:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b00029c7800/0x72011f792b786927 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786920 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.665705:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0000030a00/0x72011f792b7869f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b7869eb expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.665714:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b00126fd400/0x72011f792b786aaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c43 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.665720:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b001f8f1c00/0x72011f792b786b50 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.665884:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b00126fd400/0x72011f792b786aaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c43 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.665900:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b00126fd400/0x72011f792b786aaf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c43 expref: 9 pid: 5819 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201077.665915:0:8506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f614700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875064622447616:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788201077.666365:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0000030a00/0x72011f792b7869f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b7869eb expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.666374:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b0000030a00/0x72011f792b7869f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b7869eb expref: 18 pid: 5822 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201077.666383:0:8506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f616300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875064622447744:0@lo:104: 00000100:00100000:2.0:1788201077.666422:0:8506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201077.666492:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b00029c7800/0x72011f792b786927 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b786920 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.666501:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b00029c7800/0x72011f792b786927 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b786920 expref: 18 pid: 5822 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201077.666509:0:8506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f617b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875064622447872:0@lo:104: 00000100:00100000:2.0:1788201077.666534:0:8506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201077.672917:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201077.672976:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614033024 00000100:00100000:3.0:1788201077.672985:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614033024 00010000:00010000:3.0:1788201077.673027:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b00126fd400/0x72011f792b786aaf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c43 expref: 10 pid: 5819 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201077.673096:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:1.0:1788201077.673159:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2349:x1875064614033024:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201077.673176:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201077.673183:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b00126fd400/0x72011f792b786aaf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c43 expref: 10 pid: 5819 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201077.673197:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b00126fd400/0x72011f792b786aaf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c43 expref: 10 pid: 5819 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201077.673217:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201077.673266:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2349:x1875064614033024:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 136us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201077.675385:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788201077.675410:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622447744 00000100:00100000:0.0:1788201077.675418:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622447744 00000100:00100000:0.0:1788201077.675460:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622447872 00000100:00100000:0.0:1788201077.675463:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622447872 00000100:00100000:0.0:1788201077.675478:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201077.675486:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f614a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+4:8506:x1875064622447744:12345-0@lo:104: 00010000:00010000:0.0:1788201077.675502:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b0001681e00/0x72011f792b7869eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b7869f2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.675574:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201077.675580:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f614a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+4:8506:x1875064622447744:12345-0@lo:104: Request processed in 95us (9158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201077.675594:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201077.675610:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788201077.675616:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f935450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+3:8506:x1875064622447872:12345-0@lo:104: 00010000:00010000:0.0:1788201077.675623:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b786920 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786927 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.675656:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788201077.675661:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f935450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+3:8506:x1875064622447872:12345-0@lo:104: Request processed in 46us (9127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201077.675666:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1788201077.675716:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201077.675731:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0001681e00/0x72011f792b7869eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b7869f2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.675740:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681e00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1788201077.675745:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0001681e00/0x72011f792b7869eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b7869f2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.675754:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0001681e00/0x72011f792b7869eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b7869f2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201077.675761:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0001681e00/0x72011f792b7869eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b7869f2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201077.675767:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201077.675801:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b0001681e00/0x72011f792b7869eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b7869f2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.675807:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201077.675826:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0001681e00/0x72011f792b7869eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b7869f2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.675833:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0001681e00/0x72011f792b7869eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b7869f2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.675848:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201077.675851:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b786920 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786927 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.675857:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680600 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1788201077.675860:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b786920 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b786927 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.675872:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b786920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b786927 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201077.675879:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b786920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b786927 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201077.675884:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201077.675897:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b786920 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786927 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.675903:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201077.675919:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b786920 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786927 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.675926:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b786920 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786927 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.675936:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201077.675938:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201077.675939:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201077.675958:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201077.675971:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622448000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201077.676001:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201077.676044:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622448128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201077.676065:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201077.676092:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622448000 00000100:00100000:0.0:1788201077.676096:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622448000 00010000:00010000:0.0:1788201077.676629:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0000030a00/0x72011f792b7869f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b7869eb expref: 19 pid: 5822 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201077.677712:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622448128 00000100:00100000:3.0:1788201077.677722:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622448128 00010000:00010000:3.0:1788201077.677751:0:6691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b00029c7800/0x72011f792b786927 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786920 expref: 20 pid: 5822 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201077.677771:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201077.677778:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035938380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16f590af-689d-4459-b486-809c9db65822+20:3294:x1875064622448128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201077.677790:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201077.677795:0:6691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b00029c7800/0x72011f792b786927 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786920 expref: 20 pid: 5822 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.677805:0:6691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b00029c7800/0x72011f792b786927 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b786920 expref: 20 pid: 5822 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.677824:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201077.678618:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035938380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16f590af-689d-4459-b486-809c9db65822+20:3294:x1875064622448128:12345-0@lo:103:ldlm_bl.0 Request processed in 836us (2548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201077.678627:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1788201077.678654:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201077.678698:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622448128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201077.679835:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0001680000/0x72011f792b7868c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b7868be expref: 19 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201077.679851:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b0001680000/0x72011f792b7868c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b7868be expref: 19 pid: 5821 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201077.679865:0:8506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c06d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875064622448256:0@lo:104: 00000100:00100000:3.0:1788201077.679929:0:8506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201077.679955:0:8506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f42a900 going to sleep for 11 seconds 00010000:00010000:3.0:1788201077.679983:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00126fd400/0x72011f792b786aaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c43 expref: 10 pid: 5819 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201077.679997:0:8506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f614700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875064622447616:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201077.680011:0:8506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f616300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875064622447744:0@lo:104: 00010000:00010000:3.0:1788201077.680020:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00029c7800/0x72011f792b786927 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b786920 expref: 19 pid: 5822 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201077.680028:0:8506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f617b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875064622447872:0@lo:104: 00000100:00100000:2.0:1788201077.680921:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1788201077.680936:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622448256 00000100:00100000:2.0:1788201077.680942:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622448256 00000100:00100000:2.0:1788201077.680995:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201077.681004:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16f590af-689d-4459-b486-809c9db65822+3:8506:x1875064622448256:12345-0@lo:104: 00010000:00010000:2.0:1788201077.681031:0:5811:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b0000030200/0x72011f792b7868be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b7868c5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201077.681382:0:8506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c06d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875064622448256:0@lo:104: 00010000:00010000:3.0:1788201077.681410:0:8506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b001f8f1c00/0x72011f792b786b50 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.681465:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201077.681473:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16f590af-689d-4459-b486-809c9db65822+3:8506:x1875064622448256:12345-0@lo:104: Request processed in 469us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201077.681480:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788201077.681499:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201077.681505:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0000030200/0x72011f792b7868be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b7868c5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.681513:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030200 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1788201077.681517:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0000030200/0x72011f792b7868be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b7868c5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.681525:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0000030200/0x72011f792b7868be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b7868c5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201077.681531:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0000030200/0x72011f792b7868be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b7868c5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201077.681537:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201077.681560:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b0000030200/0x72011f792b7868be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b7868c5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.681566:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201077.681603:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0000030200/0x72011f792b7868be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b7868c5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.681610:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0000030200/0x72011f792b7868be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b7868c5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.681634:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201077.681636:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201077.681637:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201077.681645:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201077.681656:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622448384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201077.681692:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201077.681722:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622448384 00000100:00100000:2.0:1788201077.681817:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622448384 00010000:00010000:2.0:1788201077.681837:0:6691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0001680000/0x72011f792b7868c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b7868be expref: 19 pid: 5821 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201077.681867:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788201077.681874:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f615c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622448384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201077.681884:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201077.681890:0:6691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0001680000/0x72011f792b7868c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b7868be expref: 19 pid: 5821 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.681899:0:6691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0001680000/0x72011f792b7868c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b7868be expref: 19 pid: 5821 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.681915:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0001680000/0x72011f792b7868c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b7868be expref: 19 pid: 5821 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201077.681930:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201077.682084:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f615c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16f590af-689d-4459-b486-809c9db65822+18:3294:x1875064622448384:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201077.682092:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201077.682860:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:3.0:1788201077.684292:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622448384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201077.684394:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201077.684411:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003593b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+17:3292:x1875064622448000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201077.684428:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201077.684437:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0000030a00/0x72011f792b7869f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b7869eb expref: 17 pid: 5822 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.684450:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0000030a00/0x72011f792b7869f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b7869eb expref: 17 pid: 5822 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.684466:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0000030a00/0x72011f792b7869f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b7869eb expref: 17 pid: 5822 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.684479:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b001f8f1c00/0x72011f792b786b50 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.684487:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b001f8f1c00/0x72011f792b786b50 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.684501:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b001f8f1c00/0x72011f792b786b50 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.684507:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b001f8f1c00/0x72011f792b786b50 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.684512:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b001f8f1c00/0x72011f792b786b50 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.684518:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b001f8f1c00/0x72011f792b786b50 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.684540:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1c00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201077.684544:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b001f8f1c00/0x72011f792b786b50 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.684552:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b001f8f1c00/0x72011f792b786b50 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201077.688225:0:8506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b001f8f1c00/0x72011f792b786b50 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201077.688242:0:8506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b001f8f1c00/0x72011f792b786b50 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.688762:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b001f8f1c00/0x72011f792b786b50 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.688776:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b001f8f1c00/0x72011f792b786b50 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201077.688799:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201077.688933:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003593b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+16:3292:x1875064622448000:12345-0@lo:103:ldlm_bl.0 Request processed in 4526us (12928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201077.688942:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788201077.689556:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622448000:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201078.219394:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201078.540463:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622448512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201078.540526:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201078.540601:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622448512 00000100:00100000:1.0:1788201078.540608:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622448512 00000100:00100000:1.0:1788201078.540648:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201078.540656:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622448512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201078.540687:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201078.540725:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622448512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201078.540732:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788201078.540773:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035939880 x1875064622448512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201078.540791:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622448512:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1788201078.799002:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788201078.799010:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b003f8e9800 from 4 10000000:01000000:1.0:1788201078.799015:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201078.799058:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681800/0x72011f792b786b57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201078.799071:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0001681800/0x72011f792b786b57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201078.799082:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0001681800/0x72011f792b786b57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201078.799106:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027577800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622448640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201078.799200:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201078.799244:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003b29d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201078.800492:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622448640 00000100:00100000:2.0:1788201078.800502:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622448640 00000100:00100000:2.0:1788201078.800563:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788201078.800573:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+16:5825:x1875064622448640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201078.800598:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201078.800615:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b001f8f0200/0x72011f792b786b5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786b57 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201078.800639:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b001f8f0200/0x72011f792b786b5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786b57 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201078.800650:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b001f8f0200/0x72011f792b786b5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786b57 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201078.800659:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0200, rc 0) 00000100:00100000:2.0:1788201078.800717:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622448640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201078.800723:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788201078.800773:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027577800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622448640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201078.800789:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0001681800/0x72011f792b786b57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b5e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201078.800798:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0001681800/0x72011f792b786b57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786b5e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201078.800859:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f615180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622448768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201078.800890:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201078.800931:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8c1780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201078.800946:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622448768 00000100:00100000:2.0:1788201078.800950:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622448768 00000100:00100000:2.0:1788201078.800972:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788201078.800977:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622448768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201078.801923:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622448768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 940us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201078.801933:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788201078.803288:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f615180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622448768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201078.803345:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622448896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201078.803419:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201078.803456:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f8d6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201078.803590:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622448896 00000100:00100000:2.0:1788201078.803597:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622448896 00000100:00100000:2.0:1788201078.803644:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788201078.803653:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622448896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201078.803836:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622448896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201078.803844:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788201078.803889:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622448896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201078.804060:0:8546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f615f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8546:1875064622449024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201078.804095:0:8546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201078.804116:0:8546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003584d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201078.804256:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622449024 00000100:00100000:0.0:1788201078.804261:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622449024 00000100:00100000:0.0:1788201078.804288:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788201078.804295:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+17:8546:x1875064622449024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201078.804566:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+17:8546:x1875064622449024:12345-0@lo:502:llog_process_th.0 Request processed in 271us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201078.804592:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788201078.805294:0:8546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f615f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8546:1875064622449024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201078.805323:0:8546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201078.805332:0:8546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201078.805335:0:8546:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788201078.805340:0:8546:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b003f8e9800 00000020:00000080:2.0:1788201078.805343:0:8546:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788201078.805499:0:8546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f615f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8546:1875064622449152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201078.805552:0:8546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201078.805587:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622449152 00000100:00100000:2.0:1788201078.805592:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622449152 00000100:00100000:2.0:1788201078.805622:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788201078.805629:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+17:8546:x1875064622449152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201078.805778:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+17:8546:x1875064622449152:12345-0@lo:502:llog_process_th.0 Request processed in 148us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201078.805784:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788201078.805826:0:8546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003584d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201078.805839:0:8546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f615f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8546:1875064622449152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201078.805857:0:8546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201078.805861:0:8546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201078.805862:0:8546:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788201078.805866:0:8546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788201078.805918:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788201078.805935:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201078.805943:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681800/0x72011f792b786b57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b5e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201078.805953:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0001681800/0x72011f792b786b57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b5e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201078.805961:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788201078.805963:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b0010346000 from 4 10000000:01000000:2.0:1788201078.805965:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201078.805988:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0000/0x72011f792b786b65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201078.805996:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0000/0x72011f792b786b65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201078.806011:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0000/0x72011f792b786b65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201078.806024:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f615f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622449280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201078.806051:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201078.806074:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003584d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201078.806352:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622449280 00000100:00100000:1.0:1788201078.806357:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622449280 00000100:00100000:1.0:1788201078.807261:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788201078.807272:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622449280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201078.807284:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201078.807299:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0001681000/0x72011f792b786b6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786b65 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201078.807323:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0001681000/0x72011f792b786b6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786b65 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201078.807346:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0001681000/0x72011f792b786b6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786b65 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201078.807354:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681000, rc 0) 00000100:00100000:1.0:1788201078.808525:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622449280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1250us (2467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201078.808535:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788201078.808601:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f615f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622449280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201078.808619:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0000/0x72011f792b786b65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b6c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201078.808629:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0000/0x72011f792b786b65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786b6c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201078.808692:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027574380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622449408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201078.808731:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201078.808759:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003b29d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201078.810656:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622449408 00000100:00100000:0.0:1788201078.810669:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622449408 00000100:00100000:0.0:1788201078.810722:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788201078.810731:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622449408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201078.811000:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622449408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (2267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201078.811008:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788201078.811058:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027574380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622449408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201078.811107:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622449536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201078.812608:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201078.812646:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f8d6600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201078.812739:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622449536 00000100:00100000:0.0:1788201078.812747:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622449536 00000100:00100000:0.0:1788201078.812785:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788201078.812793:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622449536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201078.814129:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622449536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1331us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201078.815350:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788201078.815476:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622449536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201078.815918:0:8549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8549:1875064622449664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201078.815973:0:8549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201078.816013:0:8549:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f42a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201078.816056:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622449664 00000100:00100000:2.0:1788201078.816063:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622449664 00000100:00100000:2.0:1788201078.816107:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788201078.816116:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:8549:x1875064622449664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201078.816659:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:8549:x1875064622449664:12345-0@lo:502:llog_process_th.0 Request processed in 460us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201078.816667:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788201078.823294:0:8549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8549:1875064622449664:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201078.823344:0:8549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201078.823353:0:8549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201078.823356:0:8549:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788201078.823362:0:8549:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b0010346000 00000020:00000080:0.0:1788201078.823365:0:8549:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788201078.823874:0:8549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8549:1875064622449792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201078.823944:0:8549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201078.823982:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622449792 00000100:00100000:0.0:1788201078.823988:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622449792 00000100:00100000:0.0:1788201078.824035:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788201078.824043:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:8549:x1875064622449792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201078.824282:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:8549:x1875064622449792:12345-0@lo:502:llog_process_th.0 Request processed in 238us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201078.824289:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788201078.824338:0:8549:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f42a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201078.824354:0:8549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8549:1875064622449792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201078.825193:0:8549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201078.825202:0:8549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201078.825204:0:8549:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788201078.825208:0:8549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788201078.826506:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788201078.826532:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201078.826543:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0000/0x72011f792b786b65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b6c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201078.826556:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0000/0x72011f792b786b65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b6c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201078.826590:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201078.826592:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b0007c1d000 from 4 10000000:01000000:0.0:1788201078.826595:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201078.826632:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b004217c600/0x72011f792b786b73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201078.826640:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b004217c600/0x72011f792b786b73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201078.826651:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b004217c600/0x72011f792b786b73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201078.826677:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622449920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201078.826737:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201078.826781:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f42a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201078.826805:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622449920 00000100:00100000:0.0:1788201078.826810:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622449920 00000100:00100000:0.0:1788201078.826853:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788201078.826861:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622449920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201078.826874:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201078.826886:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b004217d000/0x72011f792b786b7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786b73 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201078.826911:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b004217d000/0x72011f792b786b7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786b73 expref: 19 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201078.826922:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b004217d000/0x72011f792b786b7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786b73 expref: 19 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201078.826941:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b004217d000, rc 0) 00000100:00100000:0.0:1788201078.826981:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622449920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201078.826988:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788201078.827034:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622449920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201078.827047:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b004217c600/0x72011f792b786b73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b7a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201078.827056:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b004217c600/0x72011f792b786b73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786b7a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201078.827104:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622450048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201078.827129:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201078.829301:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f42a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201078.831790:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622450048 00000100:00100000:2.0:1788201078.831805:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622450048 00000100:00100000:2.0:1788201078.831863:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788201078.831873:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0009fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622450048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201078.833620:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0009fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622450048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1738us (6479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201078.833638:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788201078.833835:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622450048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201078.833904:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027574380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622450176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201078.833967:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201078.834008:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003b29df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201078.834245:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622450176 00000100:00100000:2.0:1788201078.834250:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622450176 00000100:00100000:2.0:1788201078.834287:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788201078.834295:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0009fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622450176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201078.835911:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0009fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622450176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1611us (1938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201078.835928:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788201078.835989:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027574380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622450176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201078.838028:0:8552:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035939880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8552:1875064622450304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201078.838097:0:8552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201078.838239:0:8552:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f42a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201078.838293:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622450304 00000100:00100000:2.0:1788201078.838300:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622450304 00000100:00100000:2.0:1788201078.838350:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788201078.838359:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0009fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:8552:x1875064622450304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201078.838659:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0009fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:8552:x1875064622450304:12345-0@lo:502:llog_process_th.0 Request processed in 300us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201078.838668:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788201078.838751:0:8552:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035939880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8552:1875064622450304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201078.838777:0:8552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201078.838787:0:8552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201078.838790:0:8552:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788201078.838796:0:8552:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b0007c1d000 00000020:00000080:0.0:1788201078.838799:0:8552:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788201078.838878:0:8552:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035939880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8552:1875064622450432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201078.838915:0:8552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201078.838939:0:8552:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f42a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201078.839842:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622450432 00000100:00100000:2.0:1788201078.839850:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622450432 00000100:00100000:2.0:1788201078.839885:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788201078.839893:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00109dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:8552:x1875064622450432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201078.840057:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00109dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:8552:x1875064622450432:12345-0@lo:502:llog_process_th.0 Request processed in 164us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201078.840064:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788201078.840501:0:8552:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035939880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:8552:1875064622450432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201078.841529:0:8552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201078.841538:0:8552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201078.841540:0:8552:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788201078.841544:0:8552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788201078.844501:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788201078.844533:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201078.844544:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b004217c600/0x72011f792b786b73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b7a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201078.844557:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b004217c600/0x72011f792b786b73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b7a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201079.246100:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201079.449662:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201079.449757:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614033152 00000100:00100000:0.0:1788201079.449766:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614033152 00000100:00100000:0.0:1788201079.449817:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 184 00000100:00100000:0.0:1788201079.449826:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00109de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+9:5588:x1875064614033152:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201079.449841:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201079.449859:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b004217da00/0x72011f792b786b81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2c82 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201079.449886:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b004217da00/0x72011f792b786b81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c82 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201079.449896:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b004217da00/0x72011f792b786b81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c82 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201079.449905:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b004217da00, rc 0) 00000100:00100000:0.0:1788201079.450027:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00109de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:5588:x1875064614033152:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 Request processed in 201us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201079.450035:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 184 00000100:00100000:3.0:1788201079.455099:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201079.455318:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614033280 00000100:00100000:2.0:1788201079.455329:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614033280 00000100:00100000:2.0:1788201079.455402:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 185 00000100:00100000:2.0:1788201079.455412:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:5588:x1875064614033280:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201079.455682:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:5588:x1875064614033280:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 Request processed in 271us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201079.455690:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 185 00000100:00100000:0.0:1788201079.458819:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201079.458927:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614033408 00000100:00100000:1.0:1788201079.458936:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614033408 00000100:00100000:1.0:1788201079.458998:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 186 00000100:00100000:1.0:1788201079.459023:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:5588:x1875064614033408:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201079.459255:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:5588:x1875064614033408:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 Request processed in 234us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201079.459263:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 186 00000100:00100000:0.0:1788201079.464725:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201079.464805:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614033536 00000100:00100000:2.0:1788201079.464816:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614033536 00000100:00100000:2.0:1788201079.464880:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 187 00000100:00100000:2.0:1788201079.464890:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:6118:x1875064614033536:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201079.465161:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:6118:x1875064614033536:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 272us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201079.465169:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 187 00000100:00100000:0.0:1788201079.468714:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201079.468933:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614033664 00000100:00100000:1.0:1788201079.468950:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614033664 00000100:00100000:1.0:1788201079.469260:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 188 00000100:00100000:1.0:1788201079.469272:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:6118:x1875064614033664:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201079.469504:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:6118:x1875064614033664:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 234us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201079.469513:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 188 00010000:00010000:3.0:1788201080.267640:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201081.292503:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201082.144341:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201082.144390:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201082.144424:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201082.144447:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201082.144477:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614034048 00000100:00100000:3.0:1788201082.144487:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614034048 00000100:00100000:1.0:1788201082.144617:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614034176 00000100:00100000:1.0:1788201082.144622:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614034176 00000100:00100000:3.0:1788201082.144690:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:3.0:1788201082.144701:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2351:x1875064614034048:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201082.144791:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2351:x1875064614034048:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 91us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201082.144799:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:0.0:1788201082.145092:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614033792 00000100:00100000:0.0:1788201082.145104:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614033792 00000100:00100000:0.0:1788201082.145159:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 189 00000100:00100000:0.0:1788201082.145167:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2351:x1875064614033792:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201082.145198:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2351:x1875064614033792:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 33us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201082.145205:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 189 00000100:00100000:1.0:1788201082.145308:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:1.0:1788201082.145315:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2351:x1875064614034176:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201082.145344:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2351:x1875064614034176:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 30us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201082.145350:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:1.0:1788201082.145369:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614033920 00000100:00100000:1.0:1788201082.145372:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614033920 00000100:00100000:1.0:1788201082.145400:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:1.0:1788201082.145407:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2351:x1875064614033920:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201082.145434:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2351:x1875064614033920:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 27us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201082.145450:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00080000:3.0:1788201082.145980:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201082.145987:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201082.145989:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201082.315265:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201082.635329:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622450560:0@lo:400:kworker.0 00000100:00100000:2.0:1788201082.635397:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201082.635437:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622451072:0@lo:400:kworker.0 00000100:00100000:2.0:1788201082.635462:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201082.635489:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201082.635495:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622450944:0@lo:400:kworker.0 00000100:00100000:2.0:1788201082.635517:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201082.635543:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622450688:0@lo:400:kworker.0 00000100:00100000:2.0:1788201082.635578:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201082.635595:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622451200:0@lo:400:kworker.0 00000100:00100000:2.0:1788201082.635615:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201082.635645:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201082.635651:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622450816:0@lo:400:kworker.0 00000100:00100000:2.0:1788201082.635674:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201082.635707:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622451072 00000100:00100000:2.0:1788201082.635714:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622451072 00000100:00100000:2.0:1788201082.635758:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622450688 00000100:00100000:2.0:1788201082.635761:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622450688 00000100:00100000:2.0:1788201082.635772:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622450816 00000100:00100000:2.0:1788201082.635775:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622450816 00000100:00100000:2.0:1788201082.635789:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788201082.635797:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622451072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201082.635862:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622451072:12345-0@lo:400:kworker.0 Request processed in 65us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201082.635868:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788201082.635882:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201082.635888:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622450688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201082.635919:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622450688:12345-0@lo:400:kworker.0 Request processed in 31us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201082.635925:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201082.635936:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201082.635943:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622450816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201082.635968:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622450816:12345-0@lo:400:kworker.0 Request processed in 26us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201082.635974:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201082.635991:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622450944 00000100:00100000:2.0:1788201082.635994:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622450944 00000100:00100000:2.0:1788201082.636016:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622451200 00000100:00100000:2.0:1788201082.636019:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622451200 00000100:00100000:2.0:1788201082.636052:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788201082.636058:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f615f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622450944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201082.636091:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f615f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622450944:12345-0@lo:400:kworker.0 Request processed in 33us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201082.636097:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788201082.636109:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201082.636115:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622451200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201082.636170:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622451200:12345-0@lo:400:kworker.0 Request processed in 56us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201082.636177:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788201082.636200:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201082.636205:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201082.636207:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201082.636234:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622450816:0@lo:400:kworker.0 00000100:00100000:2.0:1788201082.636245:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622450688:0@lo:400:kworker.0 00010000:00080000:2.0:1788201082.636256:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b003f614380 x1875064622451200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201082.636266:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622451200:0@lo:400:kworker.0 00010000:00080000:2.0:1788201082.636299:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b003f617480 x1875064622450944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201082.636308:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622450944:0@lo:400:kworker.0 00000100:00100000:2.0:1788201082.636318:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622451072:0@lo:400:kworker.0 00000100:00100000:1.0:1788201082.636500:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622450560 00000100:00100000:1.0:1788201082.636504:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622450560 00000100:00100000:1.0:1788201082.636531:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788201082.636538:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622450560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201082.636588:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622450560:12345-0@lo:400:kworker.0 Request processed in 50us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201082.636594:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788201082.636625:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201082.636634:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622451328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201082.636657:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201082.636683:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622451328 00000100:00100000:1.0:1788201082.636686:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622451328 00000100:00100000:1.0:1788201082.636709:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201082.636715:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622451328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201082.636742:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201082.636776:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622451328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201082.636782:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201082.636818:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622450560:0@lo:400:kworker.0 00010000:00080000:1.0:1788201082.636841:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0027577800 x1875064622451328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201082.636854:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622451328:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788201083.339382:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201083.615610:0:8806:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1788201083.662333:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622451456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201083.662406:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201083.662779:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622451456 00000100:00100000:0.0:1788201083.662787:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622451456 00000100:00100000:0.0:1788201083.662852:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201083.662861:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622451456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201083.662896:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201083.662945:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622451456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201083.662952:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788201083.663024:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035939880 x1875064622451456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201083.663041:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622451456:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201084.372424:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.387972:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201086.415106:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201087.267127:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201087.267184:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201087.267213:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201087.267235:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201087.267259:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614034560 00000100:00100000:0.0:1788201087.267266:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614034560 00000100:00100000:0.0:1788201087.267316:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614034688 00000100:00100000:0.0:1788201087.267318:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614034688 00000100:00100000:0.0:1788201087.267340:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:0.0:1788201087.267350:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003593b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2350:x1875064614034560:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201087.267416:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003593b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2350:x1875064614034560:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 67us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201087.267439:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:0.0:1788201087.267454:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:0.0:1788201087.267460:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003593aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2350:x1875064614034688:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201087.267484:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003593aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2350:x1875064614034688:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 25us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201087.267489:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00080000:0.0:1788201087.267505:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201087.267508:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201087.267894:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614034432 00000100:00100000:3.0:1788201087.267899:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614034432 00000100:00100000:3.0:1788201087.267940:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 31 00000100:00100000:3.0:1788201087.267947:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003593b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2350:x1875064614034432:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201087.267984:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003593b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2350:x1875064614034432:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 38us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201087.267990:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 31 00000100:00080000:0.0:1788201087.268323:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201087.268421:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614034304 00000100:00100000:2.0:1788201087.268433:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614034304 00000100:00100000:2.0:1788201087.268471:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 191 00000100:00100000:2.0:1788201087.268478:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2351:x1875064614034304:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201087.268659:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2351:x1875064614034304:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 40us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201087.268666:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 191 00010000:00010000:0.0:1788201087.436278:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201087.756267:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201087.756289:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622451584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201087.756355:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201087.756435:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622451584 00000100:00100000:1.0:1788201087.756442:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622451584 00000100:00100000:1.0:1788201087.756497:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201087.756506:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622451584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201087.756553:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201087.756594:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622451584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201087.756602:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788201087.756621:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788201087.756649:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0027574000 x1875064622451584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201087.756666:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622451584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201087.756830:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622451712:0@lo:400:kworker.0 00000100:00100000:2.0:1788201087.756864:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201087.756900:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1875064622452224:0@lo:400:kworker.0 00000100:00100000:2.0:1788201087.756923:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201087.756941:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201087.756945:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622451840:0@lo:400:kworker.0 00000100:00100000:2.0:1788201087.756961:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201087.756984:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622452096:0@lo:400:kworker.0 00000100:00100000:2.0:1788201087.757004:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201087.757021:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201087.757026:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1875064622451968:0@lo:400:kworker.0 00000100:00100000:2.0:1788201087.757044:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201087.757066:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622451712 00000100:00100000:2.0:1788201087.757070:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622451712 00000100:00100000:2.0:1788201087.757099:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788201087.757105:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000506a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622451712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201087.757162:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000506a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622451712:12345-0@lo:400:kworker.0 Request processed in 56us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201087.757168:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788201087.757203:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622452224 00000100:00100000:2.0:1788201087.757207:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622452224 00000100:00100000:2.0:1788201087.757233:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622451840 00000100:00100000:2.0:1788201087.757235:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622451840 00000100:00100000:2.0:1788201087.757245:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622451968 00000100:00100000:2.0:1788201087.757247:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622451968 00000100:00100000:2.0:1788201087.757261:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201087.757266:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875064622452224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201087.757296:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875064622452224:12345-0@lo:400:kworker.0 Request processed in 30us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201087.757302:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201087.757314:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788201087.757319:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622451840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201087.757341:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622451840:12345-0@lo:400:kworker.0 Request processed in 22us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201087.757347:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788201087.757356:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201087.757361:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875064622451968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201087.757386:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875064622451968:12345-0@lo:400:kworker.0 Request processed in 25us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201087.757391:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201087.757411:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622452096 00000100:00100000:2.0:1788201087.757414:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622452096 00000100:00100000:2.0:1788201087.757438:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788201087.757444:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622452096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201087.757470:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622452096:12345-0@lo:400:kworker.0 Request processed in 27us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201087.757485:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788201087.757508:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201087.757525:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201087.757547:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1875064622451968:0@lo:400:kworker.0 00010000:00080000:2.0:1788201087.757556:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b003f615500 x1875064622452096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201087.757565:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622452096:0@lo:400:kworker.0 00000100:00100000:2.0:1788201087.757590:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622451840:0@lo:400:kworker.0 00000100:00100000:2.0:1788201087.757597:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622451712:0@lo:400:kworker.0 00000100:00100000:2.0:1788201087.757605:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1875064622452224:0@lo:400:kworker.0 00010000:00010000:0.0:1788201088.460537:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201088.774102:0:9050:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing yml_node 00000100:00100000:2.0:1788201088.788220:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622452352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201088.788292:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201088.789022:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622452352 00000100:00100000:0.0:1788201088.789031:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622452352 00000100:00100000:0.0:1788201088.789083:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201088.789092:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622452352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201088.789126:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201088.789207:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622452352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201088.789215:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788201088.790217:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b003593a300 x1875064622452352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201088.790240:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622452352:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201089.483326:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201090.507425:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201091.532042:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201092.022797:0:9243:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.56.54 00000100:00100000:0.0:1788201092.380310:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201092.380369:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201092.383632:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614034944 00000100:00100000:3.0:1788201092.383647:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614034944 00000100:00100000:3.0:1788201092.383733:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:3.0:1788201092.383745:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003593a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2351:x1875064614034944:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201092.383841:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003593a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2351:x1875064614034944:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 98us (3470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201092.383849:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:2.0:1788201092.384478:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614034816 00000100:00100000:2.0:1788201092.384494:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614034816 00000100:00100000:2.0:1788201092.384639:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 193 00000100:00100000:2.0:1788201092.384649:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000506b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2351:x1875064614034816:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201092.384707:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000506b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2351:x1875064614034816:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 60us (4411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201092.384715:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 193 00000100:00080000:1.0:1788201092.384953:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201092.386674:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201092.386719:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201092.386802:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614035072 00000100:00100000:2.0:1788201092.386811:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614035072 00000100:00100000:2.0:1788201092.386871:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614035200 00000100:00100000:2.0:1788201092.386875:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614035200 00000100:00100000:2.0:1788201092.386899:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:2.0:1788201092.386909:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2347:x1875064614035072:12345-192.168.203.14@tcp:9:kworker.0 00000020:00000080:2.0:1788201092.386942:0:7765:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786abd 00000100:00080000:2.0:1788201092.386966:0:7765:0:(import.c:65:import_set_state_nolock()) ffff9b001f90b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201092.387009:0:7765:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788201092.387432:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+2:2347:x1875064614035072:12345-192.168.203.14@tcp:9:kworker.0 Request processed in 523us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201092.387441:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:2.0:1788201092.387458:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:2.0:1788201092.387465:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2347:x1875064614035200:12345-192.168.203.14@tcp:9:kworker.0 00000020:00000080:2.0:1788201092.387491:0:7765:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786ac4 00000100:00080000:2.0:1788201092.387498:0:7765:0:(import.c:65:import_set_state_nolock()) ffff9b001f80a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201092.387524:0:7765:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788201092.387886:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+2:2347:x1875064614035200:12345-192.168.203.14@tcp:9:kworker.0 Request processed in 420us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201092.387894:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00010000:00010000:2.0:1788201092.387971:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201092.388080:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201092.388225:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201092.388230:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201092.555290:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201092.876521:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622452480:0@lo:400:kworker.0 00000100:00100000:0.0:1788201092.876597:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201092.876649:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035da2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622452992:0@lo:400:kworker.0 00000100:00100000:0.0:1788201092.876697:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201092.876723:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788201092.876729:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622452608:0@lo:400:kworker.0 00000100:00100000:0.0:1788201092.876751:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201092.876771:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622453120:0@lo:400:kworker.0 00000100:00100000:0.0:1788201092.876796:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201092.876825:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622452736:0@lo:400:kworker.0 00000100:00100000:0.0:1788201092.876860:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201092.876878:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201092.876884:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035da2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622452864:0@lo:400:kworker.0 00000100:00100000:0.0:1788201092.879216:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201092.885119:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622453248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201092.885213:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201092.887062:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622453248 00000100:00100000:3.0:1788201092.887074:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622453248 00000100:00100000:3.0:1788201092.887276:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201092.887288:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622453248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201092.887325:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201092.887389:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622453248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (2175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201092.887396:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788201092.887421:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788201092.887545:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0027574000 x1875064622453248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201092.887566:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622453248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201092.887600:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622452480 00000100:00100000:0.0:1788201092.887604:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622452480 00000100:00100000:0.0:1788201092.887636:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788201092.887643:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000506a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622452480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201092.887684:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000506a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622452480:12345-0@lo:400:kworker.0 Request processed in 42us (11087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201092.887691:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788201092.887735:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622452992 00000100:00100000:0.0:1788201092.887739:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622452992 00000100:00100000:0.0:1788201092.887776:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622452608 00000100:00100000:0.0:1788201092.887779:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622452608 00000100:00100000:0.0:1788201092.887790:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622452736 00000100:00100000:0.0:1788201092.887792:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622452736 00000100:00100000:0.0:1788201092.887806:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788201092.887812:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622452992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201092.887848:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622452992:12345-0@lo:400:kworker.0 Request processed in 37us (11151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201092.887854:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788201092.887866:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201092.887871:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622452608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201092.889918:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622452608:12345-0@lo:400:kworker.0 Request processed in 2036us (13156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201092.889931:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201092.889966:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788201092.889980:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622452736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201092.890050:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622452736:12345-0@lo:400:kworker.0 Request processed in 76us (13188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201092.890056:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788201092.890086:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622453120 00000100:00100000:0.0:1788201092.890092:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622453120 00000100:00100000:0.0:1788201092.890126:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622452864 00000100:00100000:0.0:1788201092.890130:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622452864 00000100:00100000:0.0:1788201092.890184:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201092.890190:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622453120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201092.890228:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622453120:12345-0@lo:400:kworker.0 Request processed in 38us (13430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201092.890250:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201092.890951:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788201092.890968:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622452864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201092.891013:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622452864:12345-0@lo:400:kworker.0 Request processed in 51us (11806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201092.891019:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788201092.891081:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003593a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622452608:0@lo:400:kworker.0 00010000:00080000:0.0:1788201092.891096:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035da2d80 x1875064622453120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201092.891106:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622453120:0@lo:400:kworker.0 00000100:00100000:0.0:1788201092.891116:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622452480:0@lo:400:kworker.0 00000100:00100000:0.0:1788201092.891127:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035da2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622452992:0@lo:400:kworker.0 00010000:00080000:0.0:1788201092.891189:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035da2300 x1875064622452864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201092.891198:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035da2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622452864:0@lo:400:kworker.0 00000100:00100000:0.0:1788201092.891207:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622452736:0@lo:400:kworker.0 00000100:00080000:3.0:1788201092.901314:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201092.901324:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788201093.582601:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201093.901669:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201093.901702:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622453376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201093.901767:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201093.902122:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622453376 00000100:00100000:1.0:1788201093.902131:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622453376 00000100:00100000:1.0:1788201093.902201:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788201093.902211:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622453376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201093.902266:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201093.902317:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622453376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201093.902325:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788201093.902375:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0027575180 x1875064622453376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201093.902393:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622453376:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788201094.563715:0:9340:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.56.54 00010000:00010000:3.0:1788201094.604609:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788201095.486055:0:6702:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa6eef1a-3f03-469a-ac4c-2a406b6709bc 00000020:00000080:3.0:1788201095.486066:0:6702:0:(genops.c:906:class_export_put()) final put ffff9b001f908800/aa6eef1a-3f03-469a-ac4c-2a406b6709bc 00000020:00000080:3.0:1788201095.486109:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b001f908800/aa6eef1a-3f03-469a-ac4c-2a406b6709bc for lustre-OST0000 00000020:00000080:3.0:1788201095.486190:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b001f90b800 for lustre-OST0000 00010000:00010000:2.0:1788201095.630953:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201096.418525:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201096.418588:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201096.418930:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614035328 00000100:00100000:3.0:1788201096.418955:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614035328 00000100:00100000:3.0:1788201096.419051:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 195 00000100:00100000:3.0:1788201096.419073:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005069850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2348:x1875064614035328:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201096.419212:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005069850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2348:x1875064614035328:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 141us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201096.419220:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 195 00000100:00100000:0.0:1788201096.421545:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614035456 00000100:00100000:0.0:1788201096.421567:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614035456 00000100:00080000:3.0:1788201096.421718:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201096.421770:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:0.0:1788201096.421784:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2348:x1875064614035456:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201096.421925:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2348:x1875064614035456:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 144us (3336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201096.421933:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 39 00000001:00100000:0.0:1788201096.596606:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa6eef1a-3f03-469a-ac4c-2a406b6709bc 00000020:00000080:0.0:1788201096.596617:0:7643:0:(genops.c:906:class_export_put()) final put ffff9b001f80b000/aa6eef1a-3f03-469a-ac4c-2a406b6709bc 00000020:00000080:3.0:1788201096.596690:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b001f80b000/aa6eef1a-3f03-469a-ac4c-2a406b6709bc for lustre-OST0001 00000020:00000080:3.0:1788201096.596751:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b001f80a000 for lustre-OST0001 00010000:00010000:3.0:1788201096.651284:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201096.870922:0:9442:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.56.54 00000100:00100000:2.0:1788201097.434867:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201097.434926:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201097.435177:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614035712 00000100:00100000:3.0:1788201097.435189:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614035712 00000100:00100000:3.0:1788201097.435258:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:3.0:1788201097.435270:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2348:x1875064614035712:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201097.435437:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2348:x1875064614035712:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 168us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201097.435455:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:0.0:1788201097.435583:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614035584 00000100:00100000:0.0:1788201097.435588:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614035584 00000100:00100000:0.0:1788201097.435665:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 196 00000100:00100000:0.0:1788201097.435674:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2348:x1875064614035584:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201097.435705:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2348:x1875064614035584:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 33us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201097.435712:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 196 00010000:00010000:1.0:1788201097.677118:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201097.998508:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622453888:0@lo:400:kworker.0 00000100:00100000:3.0:1788201097.998576:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201097.998623:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201097.998628:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622454016:0@lo:400:kworker.0 00000100:00100000:3.0:1788201097.998644:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201097.998706:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622453632:0@lo:400:kworker.0 00000100:00100000:2.0:1788201097.998737:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201097.999264:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622453760:0@lo:400:kworker.0 00000100:00100000:0.0:1788201097.999301:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201097.999326:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622454272:0@lo:400:kworker.0 00000100:00100000:0.0:1788201097.999352:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201097.999499:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622454144:0@lo:400:kworker.0 00000100:00100000:2.0:1788201097.999524:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201097.999550:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201097.999557:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035da2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622453504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201097.999582:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201097.999610:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622453888 00000100:00100000:2.0:1788201097.999618:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622453888 00000100:00100000:2.0:1788201097.999660:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622453760 00000100:00100000:2.0:1788201097.999664:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622453760 00000100:00100000:2.0:1788201097.999676:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622454144 00000100:00100000:2.0:1788201097.999678:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622454144 00000100:00100000:2.0:1788201097.999694:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201097.999702:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622453888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201097.999750:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788201097.999753:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622453888:12345-0@lo:400:kworker.0 Request processed in 50us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201097.999763:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788201097.999765:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788201097.999783:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788201097.999788:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622454016 00000100:00100000:0.0:1788201097.999793:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622454016 00000100:00100000:2.0:1788201097.999794:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622453760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201097.999828:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622454272 00000100:00100000:0.0:1788201097.999832:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622454272 00000100:00100000:2.0:1788201097.999838:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622453760:12345-0@lo:400:kworker.0 Request processed in 46us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201097.999846:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788201097.999860:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201097.999864:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788201097.999870:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622454016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201097.999877:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622454144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201097.999927:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622454144:12345-0@lo:400:kworker.0 Request processed in 54us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201097.999941:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201097.999960:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622453504 00000100:00100000:2.0:1788201097.999963:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622453504 00000100:00100000:2.0:1788201097.999987:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201097.999994:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1875064622453504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201098.000022:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201098.000029:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622454016:12345-0@lo:400:kworker.0 Request processed in 53us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201098.000045:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788201098.000061:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788201098.000071:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1875064622453504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201098.000071:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3293:x1875064622454272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201098.000084:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788201098.000109:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201098.000115:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201098.000118:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201098.000120:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622454272:12345-0@lo:400:kworker.0 Request processed in 52us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201098.000130:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788201098.000179:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622453760:0@lo:400:kworker.0 00010000:00080000:2.0:1788201098.000198:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0040904380 x1875064622454272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201098.000210:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622454272:0@lo:400:kworker.0 00010000:00080000:2.0:1788201098.000258:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035da2300 x1875064622453504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201098.000275:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035da2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622453504:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788201098.000300:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035c04000 x1875064622454016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201098.000312:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622454144:0@lo:400:kworker.0 00000100:00100000:0.0:1788201098.000314:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622454016:0@lo:400:kworker.0 00000100:00100000:0.0:1788201098.000337:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622453888:0@lo:400:kworker.0 00000100:00100000:3.0:1788201098.000399:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622453632 00000100:00100000:3.0:1788201098.000405:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622453632 00000100:00100000:3.0:1788201098.000438:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788201098.000456:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622453632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201098.000498:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622453632:12345-0@lo:400:kworker.0 Request processed in 43us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201098.000505:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788201098.001125:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622453632:0@lo:400:kworker.0 00000001:02000400:0.0:1788201098.293604:0:9491:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 31 14:31:36 EDT 2026 00010000:00010000:3.0:1788201098.699356:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201099.019406:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622454400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201099.019515:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201099.019734:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622454400 00000100:00100000:1.0:1788201099.019742:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622454400 00000100:00100000:1.0:1788201099.019817:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201099.019828:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622454400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201099.019868:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201099.019916:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622454400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201099.019923:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788201099.019965:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0027575180 x1875064622454400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201099.019985:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622454400:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201099.020755:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201099.723371:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201100.748325:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201101.771706:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201102.618461:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201102.618506:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201102.618605:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614035840 00000100:00100000:0.0:1788201102.618619:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614035840 00000100:00100000:0.0:1788201102.618696:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 198 00000100:00100000:0.0:1788201102.618709:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2351:x1875064614035840:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201102.618888:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2351:x1875064614035840:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 180us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201102.618897:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 198 00000100:00100000:2.0:1788201102.619096:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614035968 00000100:00100000:2.0:1788201102.619101:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614035968 00000100:00100000:2.0:1788201102.619177:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:2.0:1788201102.619186:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2351:x1875064614035968:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201102.619295:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2351:x1875064614035968:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 110us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201102.619302:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00080000:2.0:1788201102.619325:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788201102.795271:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201103.115458:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622454528:0@lo:400:kworker.0 00000100:00100000:3.0:1788201103.115564:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201103.117524:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622455040:0@lo:400:kworker.0 00000100:00100000:3.0:1788201103.117622:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201103.117676:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201103.117684:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622454656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201103.117714:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201103.117764:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622454528 00000100:00100000:3.0:1788201103.117774:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622454528 00000100:00100000:3.0:1788201103.117839:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788201103.117850:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622454528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201103.117918:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622454528:12345-0@lo:400:kworker.0 Request processed in 69us (2353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201103.117926:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788201103.117968:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622454784:0@lo:400:kworker.0 00000100:00100000:3.0:1788201103.117998:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201103.118023:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201103.118030:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622454912:0@lo:400:kworker.0 00000100:00100000:3.0:1788201103.118067:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201103.118303:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622454656 00000100:00100000:3.0:1788201103.118309:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622454656 00000100:00100000:3.0:1788201103.118352:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201103.118359:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622454656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201103.118477:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201103.118518:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622454656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201103.118525:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201103.118549:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622454784 00000100:00100000:3.0:1788201103.118553:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622454784 00000100:00100000:3.0:1788201103.118713:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622454912 00000100:00100000:3.0:1788201103.118718:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622454912 00000100:00100000:3.0:1788201103.118743:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201103.118750:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622454784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201103.118794:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622454784:12345-0@lo:400:kworker.0 Request processed in 44us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201103.118806:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201103.118819:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201103.118826:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622454912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201103.118901:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622454912:12345-0@lo:400:kworker.0 Request processed in 76us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201103.118910:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788201103.118929:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201103.118935:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201103.119091:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622454912:0@lo:400:kworker.0 00000100:00100000:3.0:1788201103.119103:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622454784:0@lo:400:kworker.0 00010000:00080000:3.0:1788201103.119547:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035da1f80 x1875064622454656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201103.119570:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622454656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201103.119585:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622454528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201103.120809:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622455040 00000100:00100000:1.0:1788201103.120823:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622455040 00000100:00100000:1.0:1788201103.120897:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201103.120908:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622455040:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788201103.121010:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201103.121184:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622455040:12345-0@lo:400:kworker.0 Request processed in 278us (3561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201103.121193:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788201103.121311:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035c05180 x1875064622455040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201103.121331:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622455040:0@lo:400:kworker.0 00000100:00100000:1.0:1788201103.123608:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622455168:0@lo:400:kworker.0 00000100:00100000:1.0:1788201103.123699:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201103.123890:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622455168 00000100:00100000:0.0:1788201103.123917:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622455168 00000100:00100000:0.0:1788201103.124001:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788201103.124012:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622455168:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788201103.124100:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201103.130551:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622455168:12345-0@lo:400:kworker.0 Request processed in 6522us (6832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201103.130574:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788201103.132099:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622455168:0@lo:400:kworker.0 00010000:00010000:1.0:1788201103.822917:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201104.139482:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201104.139516:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622455296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201104.139615:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201104.139903:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622455296 00000100:00100000:1.0:1788201104.139915:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622455296 00000100:00100000:1.0:1788201104.139983:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201104.139994:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622455296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201104.140043:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201104.140112:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622455296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201104.140120:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788201104.141414:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0027576d80 x1875064622455296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201104.141446:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622455296:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201104.843442:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201105.867671:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201106.891388:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201107.746347:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201107.746469:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201107.746514:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614036224 00000100:00100000:3.0:1788201107.746531:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614036224 00000100:00100000:3.0:1788201107.746613:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:3.0:1788201107.746626:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614036224:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201107.746722:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614036224:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 99us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201107.746730:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:3.0:1788201107.746758:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614036096 00000100:00100000:3.0:1788201107.746762:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614036096 00000100:00100000:3.0:1788201107.746787:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 200 00000100:00100000:3.0:1788201107.746792:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2349:x1875064614036096:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201107.746817:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2349:x1875064614036096:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 24us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201107.746823:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 200 00000100:00080000:3.0:1788201107.749396:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788201107.917167:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201108.235882:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622455808:0@lo:400:kworker.0 00000100:00100000:1.0:1788201108.236034:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1875064622455680:0@lo:400:kworker.0 00000100:00100000:2.0:1788201108.236100:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622455424:0@lo:400:kworker.0 00000100:00100000:1.0:1788201108.236232:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201108.236288:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788201108.236295:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622455552:0@lo:400:kworker.0 00000100:00100000:1.0:1788201108.236319:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201108.236339:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622456064:0@lo:400:kworker.0 00000100:00100000:1.0:1788201108.236362:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201108.236411:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622455680 00000100:00100000:1.0:1788201108.236570:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622455680 00000100:00100000:1.0:1788201108.236630:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622455552 00000100:00100000:1.0:1788201108.236634:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622455552 00000100:00100000:1.0:1788201108.236706:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788201108.236718:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875064622455680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201108.236787:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875064622455680:12345-0@lo:400:kworker.0 Request processed in 71us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201108.236796:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788201108.236815:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788201108.236822:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622455552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201108.236850:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622455552:12345-0@lo:400:kworker.0 Request processed in 28us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201108.236856:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788201108.236879:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622456064 00000100:00100000:1.0:1788201108.236883:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622456064 00000100:00100000:1.0:1788201108.236913:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201108.236919:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622456064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201108.237098:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622456064:12345-0@lo:400:kworker.0 Request processed in 178us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201108.237105:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788201108.237124:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201108.237129:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201108.237222:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622455552:0@lo:400:kworker.0 00010000:00080000:1.0:1788201108.237242:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035da0380 x1875064622456064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201108.237255:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622456064:0@lo:400:kworker.0 00000100:00100000:1.0:1788201108.237284:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1875064622455680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201108.237649:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201108.237815:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201108.237828:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035da0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622456192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201108.237867:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201108.237898:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622456192 00000100:00100000:0.0:1788201108.237903:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622456192 00000100:00100000:0.0:1788201108.238081:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201108.238091:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622456192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201108.238129:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201108.238200:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622456192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201108.238206:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788201108.238239:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035da0700 x1875064622456192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201108.238255:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035da0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622456192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201108.238354:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622455808 00000100:00100000:3.0:1788201108.238358:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622455808 00000100:00100000:3.0:1788201108.238424:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201108.238431:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622455808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201108.238751:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622455808:12345-0@lo:400:kworker.0 Request processed in 321us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201108.238759:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788201108.238783:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788201108.239089:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035da3480 x1875064622455808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201108.239103:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622455808:0@lo:400:kworker.0 00000100:00100000:2.0:1788201108.239775:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201108.239853:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622455936:0@lo:400:kworker.0 00000100:00100000:2.0:1788201108.239885:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201108.242644:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622455936 00000100:00100000:0.0:1788201108.242659:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622455936 00000100:00100000:0.0:1788201108.242743:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201108.242754:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875064622455936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201108.242848:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875064622455936:12345-0@lo:400:kworker.0 Request processed in 96us (2961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201108.242856:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201108.242909:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622455936:0@lo:400:kworker.0 00000100:00080000:2.0:1788201108.243084:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201108.251071:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622455424 00000100:00100000:3.0:1788201108.251087:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622455424 00000100:00100000:3.0:1788201108.251154:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788201108.251164:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:3295:x1875064622455424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201108.251258:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:3295:x1875064622455424:12345-0@lo:400:kworker.0 Request processed in 95us (11484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201108.251265:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788201108.251564:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622455424:0@lo:400:kworker.0 00010000:00010000:0.0:1788201108.940351:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201109.267288:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622456320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201109.267357:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201109.267489:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622456320 00000100:00100000:3.0:1788201109.267498:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622456320 00000100:00100000:3.0:1788201109.267565:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201109.267577:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622456320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201109.267625:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201109.273119:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622456320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5533us (5750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201109.273149:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788201109.281059:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0027576300 x1875064622456320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201109.281088:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622456320:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201109.963523:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201110.987409:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201111.497613:0:10121:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 14:31:50 (1788201110) === 00000100:00100000:1.0:1788201111.936578:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201111.936688:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614036352 00000100:00100000:3.0:1788201111.936702:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614036352 00000100:00100000:3.0:1788201111.936796:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 202 00000100:00100000:3.0:1788201111.936808:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:8113:x1875064614036352:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788201111.936842:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201111.936886:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b00126fda00/0x72011f792b786b88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2c89 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201111.936927:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00126fda00/0x72011f792b786b88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c89 expref: 11 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201111.936940:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b00126fda00/0x72011f792b786b88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c89 expref: 11 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201111.936952:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fda00, rc 0) 00000100:00100000:3.0:1788201111.937255:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+11:8113:x1875064614036352:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 449us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201111.937263:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 202 00000100:00100000:2.0:1788201111.945105:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201111.945308:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614036480 00000100:00100000:0.0:1788201111.945329:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614036480 00000100:00100000:0.0:1788201111.945415:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 203 00000100:00100000:0.0:1788201111.945427:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+11:8113:x1875064614036480:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788201111.946077:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+11:8113:x1875064614036480:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 647us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201111.946089:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 203 00000100:00100000:2.0:1788201111.948073:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201111.948478:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614036608 00000100:00100000:0.0:1788201111.948491:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614036608 00000100:00100000:0.0:1788201111.948576:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 204 00000100:00100000:0.0:1788201111.948588:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+11:8113:x1875064614036608:12345-192.168.203.14@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788201111.949322:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+11:8113:x1875064614036608:12345-192.168.203.14@tcp:503:mount.lustre.0 Request processed in 724us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201111.949335:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 204 00000100:00100000:1.0:1788201111.961294:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201111.961586:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614036736 00000100:00100000:0.0:1788201111.961600:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614036736 00000100:00100000:0.0:1788201111.961680:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 205 00000100:00100000:0.0:1788201111.961691:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+11:8117:x1875064614036736:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788201111.962549:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+11:8117:x1875064614036736:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 855us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201111.962559:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 205 00000100:00100000:2.0:1788201111.987463:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201111.991934:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614036864 00000100:00100000:0.0:1788201111.991958:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614036864 00000100:00100000:0.0:1788201111.992063:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 206 00000100:00100000:0.0:1788201111.992076:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+11:8117:x1875064614036864:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201111.996831:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+11:8117:x1875064614036864:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 4740us (9367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201111.996851:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 206 00000100:00100000:2.0:1788201112.000984:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201112.005895:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614036992 00000100:00100000:0.0:1788201112.005918:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614036992 00000100:00100000:0.0:1788201112.006081:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 207 00000100:00100000:0.0:1788201112.006095:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+11:8113:x1875064614036992:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788201112.006117:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201112.006156:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b000676e600/0x72011f792b786b8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2cb3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201112.006209:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b000676e600/0x72011f792b786b8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2cb3 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201112.006244:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b000676e600/0x72011f792b786b8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2cb3 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201112.006254:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676e600, rc 0) 00000100:00100000:0.0:1788201112.006359:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:8113:x1875064614036992:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 264us (5386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201112.006367:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 207 00000100:00100000:2.0:1788201112.010074:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201112.010434:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614037120 00000100:00100000:1.0:1788201112.010448:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614037120 00000100:00100000:1.0:1788201112.010569:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 208 00000100:00100000:1.0:1788201112.010582:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:8113:x1875064614037120:12345-192.168.203.14@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788201112.010617:0:5821:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788201112.010640:0:5821:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788201112.010645:0:5821:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788201112.010648:0:5821:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788201112.010651:0:5821:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00010000:00010000:1.0:1788201112.015022:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201112.017982:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:8113:x1875064614037120:12345-192.168.203.14@tcp:256:mount.lustre.0 Request processed in 7385us (7905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201112.018002:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 208 00000100:00100000:2.0:1788201112.035663:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201112.036123:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614037248 00000100:00100000:0.0:1788201112.036170:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614037248 00000100:00100000:0.0:1788201112.036248:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 209 00000100:00100000:0.0:1788201112.036260:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:8113:x1875064614037248:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788201112.036285:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201112.036312:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b000676ea00/0x72011f792b786b96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2cba expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201112.036488:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b000676ea00/0x72011f792b786b96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2cba expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201112.036503:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b000676ea00/0x72011f792b786b96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2cba expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201112.036513:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676ea00, rc 0) 00000100:00100000:0.0:1788201112.036632:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:8113:x1875064614037248:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 373us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201112.036641:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 209 00000100:00100000:2.0:1788201112.045645:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201112.045766:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614037376 00000100:00100000:3.0:1788201112.045780:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614037376 00000100:00100000:3.0:1788201112.045863:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 210 00000100:00100000:3.0:1788201112.045875:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:8113:x1875064614037376:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788201112.046331:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:8113:x1875064614037376:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 456us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201112.046352:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 210 00000100:00100000:1.0:1788201112.049323:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201112.049900:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614037504 00000100:00100000:3.0:1788201112.049915:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614037504 00000100:00100000:3.0:1788201112.053265:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 211 00000100:00100000:3.0:1788201112.053298:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:8113:x1875064614037504:12345-192.168.203.14@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788201112.059370:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:8113:x1875064614037504:12345-192.168.203.14@tcp:503:mount.lustre.0 Request processed in 6064us (10040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201112.059391:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 211 00000100:00100000:2.0:1788201112.065290:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201112.065425:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614037632 00000100:00100000:0.0:1788201112.065456:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614037632 00000100:00100000:0.0:1788201112.065568:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 212 00000100:00100000:0.0:1788201112.065579:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:8121:x1875064614037632:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788201112.067604:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:8121:x1875064614037632:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 2011us (2315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201112.067632:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 212 00000100:00100000:2.0:1788201112.075916:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201112.076054:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614037760 00000100:00100000:3.0:1788201112.076067:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614037760 00000100:00100000:3.0:1788201112.076186:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 213 00000100:00100000:3.0:1788201112.076199:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:8121:x1875064614037760:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201112.076638:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:8121:x1875064614037760:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 440us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201112.076647:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 213 00000100:00100000:2.0:1788201112.088054:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201112.088114:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201112.088334:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614038272 00000100:00100000:1.0:1788201112.088356:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614038272 00000100:00100000:1.0:1788201112.088444:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614037888 00000100:00100000:1.0:1788201112.088448:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614037888 00000100:00100000:1.0:1788201112.088475:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:0.0:1788201112.088486:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:1.0:1788201112.088492:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2351:x1875064614038272:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201112.088501:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2347:x1875064614037888:12345-192.168.203.14@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788201112.088539:0:9471:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 5e1fa00b-ddbb-4133-8a19-496b22d710da@192.168.203.14@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:0.0:1788201112.088589:0:9471:0:(genops.c:1406:class_connect()) connect: client 5e1fa00b-ddbb-4133-8a19-496b22d710da, cookie 0x72011f792b786b9d 00000100:00100000:1.0:1788201112.088596:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2351:x1875064614038272:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 110us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201112.088627:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 52 00000004:00100000:0.0:1788201112.088634:0:9471:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788201112.088918:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201112.091258:0:9471:0:(import.c:65:import_set_state_nolock()) ffff9b003f3c6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201112.091391:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e1fa00b-ddbb-4133-8a19-496b22d710da+6:2347:x1875064614037888:12345-192.168.203.14@tcp:38:mount.lustre.0 Request processed in 2887us (3270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201112.091405:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:2.0:1788201112.093602:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201112.095551:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201112.097507:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614038144 00000100:00100000:1.0:1788201112.097525:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614038144 00000100:00100000:0.0:1788201112.097592:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614038016 00000100:00100000:0.0:1788201112.097598:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614038016 00000100:00100000:0.0:1788201112.097682:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:0.0:1788201112.097695:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+7:0:x1875064614038016:12345-192.168.203.14@tcp:41:mount.lustre.0 00000100:00080000:2.0:1788201112.097698:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1788201112.097763:0:5829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788201112.097826:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:1.0:1788201112.097837:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+7:8113:x1875064614038144:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788201112.097857:0:5828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788201112.097887:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+7:0:x1875064614038016:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 193us (2349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201112.097900:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+7:8113:x1875064614038144:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 62us (4310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201112.097900:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:1.0:1788201112.097911:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:2.0:1788201112.102304:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201112.106269:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614038400 00000100:00100000:0.0:1788201112.106291:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614038400 00000100:00100000:0.0:1788201112.106432:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:0.0:1788201112.106445:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+6:8113:x1875064614038400:12345-192.168.203.14@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788201112.106597:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+6:8113:x1875064614038400:12345-192.168.203.14@tcp:40:mount.lustre.0 Request processed in 153us (4313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201112.106605:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:0.0:1788201112.109610:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201112.109734:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614038528 00000100:00100000:1.0:1788201112.109747:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614038528 00000100:00100000:1.0:1788201112.109820:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:1.0:1788201112.109831:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1875064614038528:12345-192.168.203.14@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788201112.109874:0:6677:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 5e1fa00b-ddbb-4133-8a19-496b22d710da@192.168.203.14@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:1.0:1788201112.109917:0:6677:0:(genops.c:1406:class_connect()) connect: client 5e1fa00b-ddbb-4133-8a19-496b22d710da, cookie 0x72011f792b786ba4 00002000:00100000:1.0:1788201112.109935:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5e1fa00b-ddbb-4133-8a19-496b22d710da/ffff9b003f3ac800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201112.109966:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788201112.110389:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788201112.110432:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9b003f3ab000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201112.110528:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+6:2347:x1875064614038528:12345-192.168.203.14@tcp:8:mount.lustre.0 Request processed in 696us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201112.110538:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:2.0:1788201112.111201:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201112.111239:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201112.111722:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614038656 00000100:00100000:3.0:1788201112.111734:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614038656 00000100:00100000:3.0:1788201112.111790:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:3.0:1788201112.111800:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1875064614038656:12345-192.168.203.14@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788201112.111833:0:6675:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 5e1fa00b-ddbb-4133-8a19-496b22d710da@192.168.203.14@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:3.0:1788201112.111873:0:6675:0:(genops.c:1406:class_connect()) connect: client 5e1fa00b-ddbb-4133-8a19-496b22d710da, cookie 0x72011f792b786bab 00002000:00100000:3.0:1788201112.111887:0:6675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5e1fa00b-ddbb-4133-8a19-496b22d710da/ffff9b003f466000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788201112.111912:0:6675:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788201112.112183:0:6675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788201112.112214:0:6675:0:(import.c:65:import_set_state_nolock()) ffff9b003f463800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201112.112294:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e1fa00b-ddbb-4133-8a19-496b22d710da+6:2347:x1875064614038656:12345-192.168.203.14@tcp:8:mount.lustre.0 Request processed in 494us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201112.112303:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:1.0:1788201112.112826:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614038784 00000100:00100000:1.0:1788201112.112834:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614038784 00000100:00100000:1.0:1788201112.112911:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:1.0:1788201112.112921:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e1fa00b-ddbb-4133-8a19-496b22d710da+6:8113:x1875064614038784:12345-192.168.203.14@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788201112.113192:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1788201112.113831:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e1fa00b-ddbb-4133-8a19-496b22d710da+6:8113:x1875064614038784:12345-192.168.203.14@tcp:33:mount.lustre.0 Request processed in 907us (2585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201112.113843:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 1 00010000:00010000:0.0:1788201113.036508:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201113.357393:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201113.357425:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622456448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201113.357517:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201113.357614:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622456448 00000100:00100000:0.0:1788201113.357623:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622456448 00000100:00100000:0.0:1788201113.357694:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201113.357704:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622456448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201113.357736:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201113.357784:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622456448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201113.357792:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788201113.357815:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788201113.357849:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035da3480 x1875064622456448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201113.357869:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622456448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201113.358084:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622456960:0@lo:400:kworker.0 00000100:00100000:1.0:1788201113.358182:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201113.358209:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201113.358215:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622456832:0@lo:400:kworker.0 00000100:00100000:1.0:1788201113.358245:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201113.358277:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622456960 00000100:00100000:1.0:1788201113.358281:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622456960 00000100:00100000:1.0:1788201113.358323:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201113.358341:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622456960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201113.358382:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622456960:12345-0@lo:400:kworker.0 Request processed in 52us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201113.358389:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201113.358411:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622456832 00000100:00100000:1.0:1788201113.358415:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622456832 00000100:00100000:1.0:1788201113.358444:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201113.358451:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622456832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201113.358479:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622456832:12345-0@lo:400:kworker.0 Request processed in 29us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201113.358486:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201113.358518:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622456832:0@lo:400:kworker.0 00010000:00080000:1.0:1788201113.358539:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0027574380 x1875064622456960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201113.358549:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622456960:0@lo:400:kworker.0 00000100:00080000:1.0:1788201113.358568:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201113.358572:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201113.358659:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622456704:0@lo:400:kworker.0 00000100:00100000:3.0:1788201113.358693:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201113.358712:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788201113.358717:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622456576:0@lo:400:kworker.0 00000100:00100000:3.0:1788201113.358753:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201113.358777:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622457088:0@lo:400:kworker.0 00000100:00100000:3.0:1788201113.358798:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201113.358853:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622456704 00000100:00100000:1.0:1788201113.358857:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622456704 00000100:00100000:1.0:1788201113.358886:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622457088 00000100:00100000:1.0:1788201113.358889:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622457088 00000100:00100000:1.0:1788201113.358912:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201113.358918:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622456704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201113.358972:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622456704:12345-0@lo:400:kworker.0 Request processed in 39us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201113.358978:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201113.358992:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201113.358998:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622457088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201113.359039:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622457088:12345-0@lo:400:kworker.0 Request processed in 41us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201113.359046:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788201113.359188:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201113.359210:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0005136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622457088:0@lo:400:kworker.0 00000100:00100000:1.0:1788201113.359221:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622456704:0@lo:400:kworker.0 00000100:00100000:0.0:1788201113.359554:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622456576 00000100:00100000:0.0:1788201113.359560:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622456576 00000100:00100000:0.0:1788201113.359606:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788201113.359614:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622456576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201113.359672:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622456576:12345-0@lo:400:kworker.0 Request processed in 59us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201113.359679:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788201113.359785:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622456576:0@lo:400:kworker.0 00010000:00010000:2.0:1788201114.064450:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201114.379717:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201114.379748:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622457216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201114.379996:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201114.380203:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622457216 00000100:00100000:3.0:1788201114.380216:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622457216 00000100:00100000:3.0:1788201114.380284:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201114.380295:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622457216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201114.380352:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201114.380415:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622457216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201114.380423:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788201114.380471:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b003f613100 x1875064622457216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201114.380493:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622457216:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201115.086883:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788201115.995341:0:6702:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5e1fa00b-ddbb-4133-8a19-496b22d710da 00010000:00010000:1.0:1788201116.107972:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788201117.038406:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5e1fa00b-ddbb-4133-8a19-496b22d710da 00000001:00100000:1.0:1788201117.043397:0:5849:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5e1fa00b-ddbb-4133-8a19-496b22d710da 00010000:00010000:0.0:1788201117.131821:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201117.475602:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201117.475700:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201117.475735:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201117.475753:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201117.475779:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201117.475812:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614039168 00000100:00100000:1.0:1788201117.475824:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614039168 00000100:00100000:1.0:1788201117.475897:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614039040 00000100:00100000:1.0:1788201117.475901:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614039040 00000100:00100000:1.0:1788201117.475931:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 56 00000100:00100000:1.0:1788201117.475957:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2351:x1875064614039168:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201117.477340:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:0.0:1788201117.477365:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2351:x1875064614039040:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201117.477509:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2351:x1875064614039168:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 1566us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201117.477519:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 56 00000100:00100000:1.0:1788201117.477566:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614039424 00000100:00100000:1.0:1788201117.477574:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614039424 00000100:00100000:1.0:1788201117.477613:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614039296 00000100:00100000:1.0:1788201117.477616:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614039296 00000100:00100000:1.0:1788201117.477639:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:1.0:1788201117.477646:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006650700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2351:x1875064614039424:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201117.478725:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614038912 00000100:00100000:3.0:1788201117.478736:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614038912 00000100:00100000:3.0:1788201117.478802:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 215 00000100:00100000:3.0:1788201117.478812:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2351:x1875064614038912:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201117.479030:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2351:x1875064614039040:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 1673us (3271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201117.479271:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:0.0:1788201117.479322:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:0.0:1788201117.479334:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2351:x1875064614039296:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201117.479369:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2351:x1875064614039296:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 39us (3589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201117.479375:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00080000:0.0:1788201117.479815:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201117.479822:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201117.479826:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201117.482909:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006650700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2351:x1875064614039424:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 5244us (7154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201117.482930:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:3.0:1788201117.486529:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2351:x1875064614038912:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 7701us (10924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201117.486550:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 215 00000001:02000400:3.0:1788201117.859809:0:10321:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1788201118.158218:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201118.475488:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622457472:0@lo:400:kworker.0 00000100:00100000:1.0:1788201118.475583:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201118.475653:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622457984:0@lo:400:kworker.0 00000100:00100000:1.0:1788201118.475702:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201118.475749:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201118.475756:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622457344:0@lo:400:kworker.0 00000100:00100000:1.0:1788201118.475795:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201118.475819:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622457856:0@lo:400:kworker.0 00000100:00100000:1.0:1788201118.475842:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201118.475873:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622457600:0@lo:400:kworker.0 00000100:00100000:1.0:1788201118.475897:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201118.475914:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201118.475919:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622457728:0@lo:400:kworker.0 00000100:00100000:1.0:1788201118.475940:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201118.475975:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622457472 00000100:00100000:1.0:1788201118.475983:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622457472 00000100:00100000:1.0:1788201118.476031:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622457856 00000100:00100000:1.0:1788201118.476034:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622457856 00000100:00100000:1.0:1788201118.476056:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622457600 00000100:00100000:1.0:1788201118.476058:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622457600 00000100:00100000:1.0:1788201118.476073:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788201118.476081:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622457472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201118.476168:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622457472:12345-0@lo:400:kworker.0 Request processed in 87us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201118.476176:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788201118.476195:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201118.476200:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875064622457856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201118.476224:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875064622457856:12345-0@lo:400:kworker.0 Request processed in 24us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201118.476230:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201118.476247:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788201118.476252:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622457600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201118.476280:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622457600:12345-0@lo:400:kworker.0 Request processed in 28us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201118.476286:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788201118.476316:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622457984 00000100:00100000:1.0:1788201118.476320:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622457984 00000100:00100000:1.0:1788201118.476347:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622457728 00000100:00100000:1.0:1788201118.476350:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622457728 00000100:00100000:1.0:1788201118.476371:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201118.476377:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622457984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201118.476417:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622457984:12345-0@lo:400:kworker.0 Request processed in 39us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201118.476425:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201118.476437:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201118.476443:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006653100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622457728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201118.476475:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006653100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622457728:12345-0@lo:400:kworker.0 Request processed in 32us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201118.476482:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201118.476507:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622457344 00000100:00100000:1.0:1788201118.476511:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622457344 00000100:00080000:0.0:1788201118.476539:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201118.476546:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201118.476549:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00080000:0.0:1788201118.476551:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201118.476561:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3295:x1875064622457344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201118.476597:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3295:x1875064622457344:12345-0@lo:400:kworker.0 Request processed in 40us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201118.476603:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788201118.476623:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201118.476638:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622458112:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788201118.476681:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0006653b80 x1875064622457728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201118.476705:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622457728:0@lo:400:kworker.0 00000100:00100000:1.0:1788201118.476718:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622457600:0@lo:400:kworker.0 00000100:00100000:1.0:1788201118.476757:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622457344:0@lo:400:kworker.0 00000100:00100000:1.0:1788201118.476768:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622457856:0@lo:400:kworker.0 00000100:00100000:1.0:1788201118.476778:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622457472:0@lo:400:kworker.0 00010000:00080000:1.0:1788201118.476786:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0006651c00 x1875064622457984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201118.476794:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622457984:0@lo:400:kworker.0 00000100:00100000:0.0:1788201118.476882:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201118.483390:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622458112 00000100:00100000:1.0:1788201118.483412:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622458112 00000100:00100000:1.0:1788201118.483509:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201118.483523:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622458112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201118.483577:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201118.483700:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622458112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (6824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201118.483707:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788201118.483759:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035da3480 x1875064622458112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201118.483801:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622458112:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201119.187800:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201119.499447:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622458240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201119.499526:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201119.499656:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622458240 00000100:00100000:2.0:1788201119.499664:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622458240 00000100:00100000:2.0:1788201119.499732:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201119.499743:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622458240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201119.499780:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201119.500817:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622458240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1071us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201119.500845:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788201119.505462:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b003f613800 x1875064622458240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201119.505491:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622458240:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201120.207042:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201121.228226:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201122.252611:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201122.591405:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201122.591456:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201122.591489:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201122.591505:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614039552 00000100:00100000:3.0:1788201122.591531:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614039552 00000100:00100000:1.0:1788201122.591532:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614039808 00000100:00100000:1.0:1788201122.591536:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614039808 00000100:00100000:3.0:1788201122.591585:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 217 00000100:00100000:1.0:1788201122.591585:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:0.0:1788201122.591592:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201122.591598:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2350:x1875064614039552:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201122.591608:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2350:x1875064614039808:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201122.591629:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201122.591669:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2350:x1875064614039808:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 74us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201122.591677:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:1.0:1788201122.591694:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614039680 00000100:00100000:1.0:1788201122.591697:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614039680 00000100:00100000:1.0:1788201122.591717:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 62 00000100:00100000:1.0:1788201122.591723:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2350:x1875064614039680:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201122.592402:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614040064 00000100:00100000:2.0:1788201122.592410:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614040064 00000100:00100000:2.0:1788201122.592462:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614039936 00000100:00100000:2.0:1788201122.592466:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614039936 00000100:00100000:2.0:1788201122.592489:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 31 00000100:00100000:2.0:1788201122.592498:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2350:x1875064614040064:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201122.599728:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2350:x1875064614039552:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 8122us (8321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201122.599743:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 217 00000100:00100000:3.0:1788201122.599853:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:3.0:1788201122.599870:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2350:x1875064614039936:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201122.600686:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2350:x1875064614039936:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 821us (9056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201122.600694:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00080000:0.0:1788201122.603261:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201122.603282:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201122.603285:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201122.605462:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2350:x1875064614039680:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 13726us (13860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201122.605478:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 62 00000100:00100000:2.0:1788201122.608333:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2350:x1875064614040064:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 15822us (16830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201122.608349:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 31 00010000:00010000:1.0:1788201123.279255:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201123.595497:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622458368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201123.595591:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201123.596488:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622458624:0@lo:400:kworker.0 00000100:00100000:1.0:1788201123.596535:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201123.596563:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201123.596570:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622458752:0@lo:400:kworker.0 00000100:00100000:1.0:1788201123.596594:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201123.596642:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622458624 00000100:00100000:1.0:1788201123.596740:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622458624 00000100:00100000:1.0:1788201123.596793:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622458752 00000100:00100000:1.0:1788201123.596797:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622458752 00000100:00100000:1.0:1788201123.596833:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201123.596843:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622458624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201123.596902:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622458624:12345-0@lo:400:kworker.0 Request processed in 60us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201123.596910:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201123.596991:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201123.596999:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622458752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201123.597180:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622458752:12345-0@lo:400:kworker.0 Request processed in 181us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201123.597187:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1788201123.597217:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201123.597233:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622458496:0@lo:400:kworker.0 00000100:00100000:1.0:1788201123.597279:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201123.597308:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622459008:0@lo:400:kworker.0 00000100:00100000:1.0:1788201123.597332:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201123.597351:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201123.597356:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622458880:0@lo:400:kworker.0 00000100:00100000:1.0:1788201123.597381:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201123.597416:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622458496 00000100:00100000:1.0:1788201123.597420:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622458496 00000100:00100000:1.0:1788201123.597452:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788201123.597458:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3295:x1875064622458496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201123.597491:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3295:x1875064622458496:12345-0@lo:400:kworker.0 Request processed in 33us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201123.597497:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788201123.597526:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622458880 00000100:00100000:1.0:1788201123.597529:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622458880 00000100:00100000:1.0:1788201123.597565:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201123.597571:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622458880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201123.597599:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622458880:12345-0@lo:400:kworker.0 Request processed in 28us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201123.597605:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788201123.597636:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201123.597908:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622458368 00000100:00100000:0.0:1788201123.597913:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622458368 00000100:00100000:1.0:1788201123.598168:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622458752:0@lo:400:kworker.0 00000100:00100000:1.0:1788201123.598185:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622458624:0@lo:400:kworker.0 00010000:00080000:1.0:1788201123.598228:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0006650a80 x1875064622458880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201123.598238:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622458880:0@lo:400:kworker.0 00000100:00100000:1.0:1788201123.598245:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622458496:0@lo:400:kworker.0 00000100:00100000:1.0:1788201123.598282:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622459008 00000100:00100000:1.0:1788201123.598286:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622459008 00000100:00100000:0.0:1788201123.602324:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201123.602345:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622458368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201123.602403:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201123.602520:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622458368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 182us (6928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201123.602543:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201123.606693:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788201123.606718:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875064622459008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201123.606859:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875064622459008:12345-0@lo:400:kworker.0 Request processed in 148us (9524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201123.606867:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788201123.607046:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035939880 x1875064622458368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201123.607076:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622458368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201123.607268:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622459008:0@lo:400:kworker.0 00000100:00080000:2.0:1788201123.607491:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201123.608212:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201124.299334:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201124.620374:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201124.620399:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622459136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201124.620474:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201124.620585:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622459136 00000100:00100000:1.0:1788201124.620594:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622459136 00000100:00100000:1.0:1788201124.620660:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788201124.620670:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003593a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622459136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201124.620711:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201124.620758:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003593a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622459136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201124.620782:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788201124.620849:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0027574380 x1875064622459136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201124.620873:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622459136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201125.329484:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201126.363506:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201127.371323:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201127.711073:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201127.711226:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201127.711262:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201127.711281:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201127.711307:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201127.711335:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614040448 00000100:00100000:1.0:1788201127.711345:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614040448 00000100:00100000:1.0:1788201127.711401:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614040320 00000100:00100000:1.0:1788201127.711404:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614040320 00000100:00100000:1.0:1788201127.711423:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 66 00000100:00100000:1.0:1788201127.711432:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2348:x1875064614040448:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201127.711519:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2348:x1875064614040448:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 87us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201127.711528:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 66 00000100:00100000:1.0:1788201127.711546:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00100000:1.0:1788201127.711552:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2348:x1875064614040320:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201127.711590:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2348:x1875064614040320:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 37us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201127.711596:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00100000:0.0:1788201127.712754:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614040704 00000100:00100000:0.0:1788201127.712764:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614040704 00000100:00100000:0.0:1788201127.712812:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614040576 00000100:00100000:0.0:1788201127.712815:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614040576 00000100:00100000:0.0:1788201127.712841:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:0.0:1788201127.712851:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2348:x1875064614040704:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201127.712905:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2348:x1875064614040704:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 56us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201127.712913:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:0.0:1788201127.712927:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:0.0:1788201127.712935:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2348:x1875064614040576:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201127.712961:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2348:x1875064614040576:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 27us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201127.712966:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00080000:0.0:1788201127.712981:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201127.712985:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201127.712988:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201127.721299:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614040192 00000100:00100000:2.0:1788201127.721314:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614040192 00000100:00100000:0.0:1788201127.723182:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 219 00000100:00100000:0.0:1788201127.723196:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2348:x1875064614040192:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201127.723297:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2348:x1875064614040192:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 104us (12560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201127.723321:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 219 00010000:00010000:1.0:1788201128.395917:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201128.715425:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622459392:0@lo:400:kworker.0 00000100:00100000:2.0:1788201128.715457:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622459648:0@lo:400:kworker.0 00000100:00100000:2.0:1788201128.715512:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201128.715516:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201128.715576:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788201128.715582:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622459264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201128.715609:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201128.715614:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622459520:0@lo:400:kworker.0 00000100:00100000:2.0:1788201128.715638:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622459776:0@lo:400:kworker.0 00000100:00100000:3.0:1788201128.715664:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201128.715671:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201128.715697:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622460032:0@lo:400:kworker.0 00000100:00100000:2.0:1788201128.715708:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622459776 00000100:00100000:2.0:1788201128.715715:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622459776 00000100:00100000:3.0:1788201128.715726:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201128.715758:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201128.715766:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622459904:0@lo:400:kworker.0 00000100:00100000:2.0:1788201128.715767:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622460032 00000100:00100000:2.0:1788201128.715771:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622460032 00000100:00100000:2.0:1788201128.715800:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788201128.715801:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201128.715827:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622459776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201128.715840:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788201128.715852:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622460032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201128.715895:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622459776:12345-0@lo:400:kworker.0 Request processed in 71us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201128.715903:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622460032:12345-0@lo:400:kworker.0 Request processed in 53us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201128.715906:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788201128.715916:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788201128.715929:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201128.715934:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201128.715957:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622459648 00000100:00100000:3.0:1788201128.715962:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622459648 00010000:00080000:2.0:1788201128.715975:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b003f612300 x1875064622459776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201128.715989:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622459776:0@lo:400:kworker.0 00000100:00100000:3.0:1788201128.715999:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622459520 00000100:00100000:3.0:1788201128.716003:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622459520 00000100:00080000:2.0:1788201128.716011:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201128.716019:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622459904 00000100:00100000:3.0:1788201128.716023:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622459904 00010000:00080000:2.0:1788201128.716040:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b003f612d80 x1875064622460032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201128.716051:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788201128.716052:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622460032:0@lo:400:kworker.0 00000100:00100000:3.0:1788201128.716062:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622459648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201128.716085:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788201128.716095:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622459520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201128.716108:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622459648:12345-0@lo:400:kworker.0 Request processed in 48us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201128.716116:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788201128.716162:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788201128.716162:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622459520:12345-0@lo:400:kworker.0 Request processed in 68us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201128.716172:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875064622459904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201128.716173:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788201128.716204:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622459520:0@lo:400:kworker.0 00000100:00100000:3.0:1788201128.716210:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875064622459904:12345-0@lo:400:kworker.0 Request processed in 40us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201128.716216:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788201128.716235:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622459904:0@lo:400:kworker.0 00000100:00080000:3.0:1788201128.716246:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201128.716270:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622459392 00000100:00100000:3.0:1788201128.716274:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622459392 00000100:00100000:3.0:1788201128.716298:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788201128.716303:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622459392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201128.716331:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622459392:12345-0@lo:400:kworker.0 Request processed in 28us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201128.716336:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788201128.716374:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622459264 00000100:00100000:3.0:1788201128.716378:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622459264 00000100:00100000:3.0:1788201128.716401:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201128.716407:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622459264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201128.716443:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201128.716475:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622459264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201128.716481:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201128.716494:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622459648:0@lo:400:kworker.0 00010000:00080000:2.0:1788201128.716516:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0006650a80 x1875064622459264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201128.716530:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622459264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201128.719282:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622459392:0@lo:400:kworker.0 00010000:00010000:0.0:1788201129.419315:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201129.740962:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201129.740987:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622460160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201129.741078:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201129.741298:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622460160 00000100:00100000:1.0:1788201129.741305:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622460160 00000100:00100000:1.0:1788201129.741351:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201129.741359:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622460160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201129.741390:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201129.741440:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622460160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201129.741446:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788201129.741543:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0006650000 x1875064622460160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201129.741561:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622460160:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788201130.445032:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201131.471383:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201132.491442:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201132.832114:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201132.832302:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201132.832342:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201132.832365:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201132.832385:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201132.832410:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614041088 00000100:00100000:0.0:1788201132.832419:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614041088 00000100:00100000:0.0:1788201132.832469:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614040960 00000100:00100000:0.0:1788201132.832471:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614040960 00000100:00100000:0.0:1788201132.832492:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 71 00000100:00100000:0.0:1788201132.832501:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2351:x1875064614041088:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201132.832645:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2351:x1875064614041088:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 144us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201132.832652:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 71 00000100:00100000:0.0:1788201132.832669:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 72 00000100:00100000:0.0:1788201132.832676:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2351:x1875064614040960:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201132.832701:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2351:x1875064614040960:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 26us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201132.832707:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 72 00000100:00100000:0.0:1788201132.832729:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614041216 00000100:00100000:0.0:1788201132.832739:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614041216 00000100:00100000:0.0:1788201132.832834:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614041344 00000100:00100000:0.0:1788201132.832838:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614041344 00000100:00100000:0.0:1788201132.832859:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:0.0:1788201132.832866:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2347:x1875064614041216:12345-192.168.203.14@tcp:9:kworker.0 00000020:00000080:0.0:1788201132.832885:0:6678:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786ba4 00000100:00080000:0.0:1788201132.832893:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9b003f3ab000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201132.832925:0:6678:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788201132.833031:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614040832 00000100:00100000:3.0:1788201132.833036:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614040832 00000100:00100000:3.0:1788201132.833064:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 221 00000100:00100000:3.0:1788201132.833072:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2351:x1875064614040832:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201132.833107:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2351:x1875064614040832:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 37us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201132.833115:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 221 00000100:00080000:3.0:1788201132.834343:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201132.834350:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201132.834354:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201132.834375:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:3.0:1788201132.834388:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2347:x1875064614041344:12345-192.168.203.14@tcp:9:kworker.0 00000020:00000080:3.0:1788201132.834413:0:6677:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786bab 00000100:00080000:3.0:1788201132.834420:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9b003f463800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201132.834456:0:6677:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788201132.834836:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+2:2347:x1875064614041344:12345-192.168.203.14@tcp:9:kworker.0 Request processed in 449us (2447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201132.834844:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 15 00010000:00010000:3.0:1788201132.834867:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201132.835718:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+2:2347:x1875064614041216:12345-192.168.203.14@tcp:9:kworker.0 Request processed in 2847us (3346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201132.835728:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 14 00010000:00010000:0.0:1788201132.837308:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201133.515379:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201133.836874:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622460672:0@lo:400:kworker.0 00000100:00100000:3.0:1788201133.836936:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201133.836999:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788201133.837005:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622460288:0@lo:400:kworker.0 00000100:00100000:3.0:1788201133.837033:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201133.837055:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622460800:0@lo:400:kworker.0 00000100:00100000:3.0:1788201133.837077:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201133.837100:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622460544:0@lo:400:kworker.0 00000100:00100000:3.0:1788201133.837121:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201133.837162:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788201133.837168:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622460416:0@lo:400:kworker.0 00000100:00100000:3.0:1788201133.837202:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201133.837245:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622460928:0@lo:400:kworker.0 00000100:00100000:3.0:1788201133.837266:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201133.837295:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622460672 00000100:00100000:3.0:1788201133.837302:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622460672 00000100:00100000:3.0:1788201133.837347:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622460928 00000100:00100000:3.0:1788201133.837350:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622460928 00000100:00100000:3.0:1788201133.837371:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201133.837381:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622460672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201133.837434:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622460672:12345-0@lo:400:kworker.0 Request processed in 55us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201133.837442:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201133.837455:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201133.837461:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622460928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201133.837491:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622460928:12345-0@lo:400:kworker.0 Request processed in 30us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201133.837510:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201133.837529:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622460288 00000100:00100000:3.0:1788201133.837532:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622460288 00000100:00100000:3.0:1788201133.837557:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788201133.837563:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622460288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201133.837592:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622460288:12345-0@lo:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201133.837597:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788201133.837621:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622460800 00000100:00100000:3.0:1788201133.837625:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622460800 00000100:00100000:3.0:1788201133.837646:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622460544 00000100:00100000:3.0:1788201133.837649:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622460544 00000100:00100000:3.0:1788201133.837659:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622460416 00000100:00100000:3.0:1788201133.837660:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622460416 00000100:00100000:3.0:1788201133.837670:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788201133.837675:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622460800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201133.837702:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622460800:12345-0@lo:400:kworker.0 Request processed in 27us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201133.837708:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788201133.837718:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788201133.837723:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622460544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201133.837745:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622460544:12345-0@lo:400:kworker.0 Request processed in 23us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201133.837750:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788201133.837759:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788201133.837763:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622460416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201133.837797:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622460416:12345-0@lo:400:kworker.0 Request processed in 33us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201133.837803:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788201133.837818:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201133.837822:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201133.837824:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201133.837854:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622460416:0@lo:400:kworker.0 00010000:00080000:3.0:1788201133.837866:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b000673ea00 x1875064622460928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201133.837875:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622460928:0@lo:400:kworker.0 00000100:00100000:3.0:1788201133.837882:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622460544:0@lo:400:kworker.0 00000100:00100000:3.0:1788201133.837907:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622460288:0@lo:400:kworker.0 00000100:00100000:3.0:1788201133.837914:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622460800:0@lo:400:kworker.0 00010000:00080000:3.0:1788201133.837922:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b000673c700 x1875064622460672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201133.837930:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622460672:0@lo:400:kworker.0 00000100:00100000:1.0:1788201133.842994:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201133.843021:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622461056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201133.843094:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201133.845499:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622461056 00000100:00100000:0.0:1788201133.845512:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622461056 00000100:00100000:0.0:1788201133.845680:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788201133.845690:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622461056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201133.845727:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201133.845809:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622461056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (2715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201133.845816:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788201133.845857:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0006652d80 x1875064622461056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201133.845875:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622461056:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788201134.234968:0:11021:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788201134.539830:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201134.859669:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622461184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201134.859780:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201134.861092:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622461184 00000100:00100000:3.0:1788201134.861110:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622461184 00000100:00100000:0.0:1788201134.862798:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201134.863379:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622461184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201134.863451:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201134.868711:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622461184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5834us (8921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201134.868725:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788201134.869130:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0006650a80 x1875064622461184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201134.869199:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622461184:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201135.566615:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788201136.467707:0:6702:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5e1fa00b-ddbb-4133-8a19-496b22d710da 00000020:00000080:2.0:1788201136.467717:0:6702:0:(genops.c:906:class_export_put()) final put ffff9b003f3ac800/5e1fa00b-ddbb-4133-8a19-496b22d710da 00000020:00000080:2.0:1788201136.467746:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b003f3ac800/5e1fa00b-ddbb-4133-8a19-496b22d710da for lustre-OST0000 00000020:00000080:2.0:1788201136.467786:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b003f3ab000 for lustre-OST0000 00010000:00010000:0.0:1788201136.589020:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788201137.482333:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5e1fa00b-ddbb-4133-8a19-496b22d710da 00000020:00000080:3.0:1788201137.482342:0:7643:0:(genops.c:906:class_export_put()) final put ffff9b003f466000/5e1fa00b-ddbb-4133-8a19-496b22d710da 00000020:00000080:3.0:1788201137.482367:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b003f466000/5e1fa00b-ddbb-4133-8a19-496b22d710da for lustre-OST0001 00000020:00000080:3.0:1788201137.482407:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b003f463800 for lustre-OST0001 00010000:00010000:1.0:1788201137.613804:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201137.730445:0:11169:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf537ce00 20000000:00000080:1.0:1788201137.730462:0:11169:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b003f450800 uarg=0000000000000000 20000000:01000000:1.0:1788201137.730499:0:11169:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788201137.730505:0:11169:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788201137.730510:0:11169:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788201137.731461:0:11170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788201137.738988:0:11169:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788201137.751648:0:11169:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788201137.751719:0:11169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0001681e00/0x72011f792b786bb2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201137.751739:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b001f8f0200/0x72011f792b786b5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786b57 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201137.751747:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0001681000/0x72011f792b786b6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786b65 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201137.751769:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b004217d000/0x72011f792b786b7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786b73 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201137.751778:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b004217da00/0x72011f792b786b81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c82 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201137.751785:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b000676ea00/0x72011f792b786b96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2cba expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201137.751791:0:11169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0001681e00/0x72011f792b786bb2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201137.751834:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b000676ea00/0x72011f792b786b96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2cba expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201137.751849:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b000676ea00/0x72011f792b786b96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2cba expref: 12 pid: 5822 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201137.751864:0:11169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006650a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875064622461312:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201137.751965:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b004217da00/0x72011f792b786b81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c82 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201137.751983:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b004217da00/0x72011f792b786b81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c82 expref: 12 pid: 5821 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201137.751992:0:11169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006652d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875064622461440:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201137.752037:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b004217d000/0x72011f792b786b7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b786b73 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201137.752046:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b004217d000/0x72011f792b786b7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b786b73 expref: 18 pid: 5821 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201137.752055:0:11169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f399880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875064622461568:0@lo:104: 00000100:00100000:1.0:1788201137.752096:0:11169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201137.752307:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622461568 00000100:00100000:2.0:1788201137.752314:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622461568 00000100:00100000:2.0:1788201137.752362:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788201137.752371:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+3:11169:x1875064622461568:12345-0@lo:104: 00010000:00010000:2.0:1788201137.752383:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b004217c600/0x72011f792b786b73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786b7a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.752436:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201137.752442:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+3:11169:x1875064622461568:12345-0@lo:104: Request processed in 72us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201137.752448:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1788201137.752470:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201137.752476:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b004217c600/0x72011f792b786b73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786b7a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.752484:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b004217c600 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1788201137.752494:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b004217c600/0x72011f792b786b73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b786b7a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.752503:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b004217c600/0x72011f792b786b73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b786b7a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201137.752510:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b004217c600/0x72011f792b786b73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b786b7a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201137.752516:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201137.752541:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b004217c600/0x72011f792b786b73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786b7a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.752548:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201137.752568:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b004217c600/0x72011f792b786b73 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786b7a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.752574:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b004217c600/0x72011f792b786b73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786b7a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.752588:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201137.752590:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201137.752591:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201137.752603:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622461824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201137.752649:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201137.752684:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622461824 00000100:00100000:2.0:1788201137.752688:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622461824 00010000:00010000:2.0:1788201137.752704:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b004217d000/0x72011f792b786b7a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786b73 expref: 19 pid: 5821 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201137.752726:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201137.752738:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006799450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622461824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201137.752749:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201137.752754:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b004217d000/0x72011f792b786b7a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786b73 expref: 19 pid: 5821 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201137.753742:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0001681000/0x72011f792b786b6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b786b65 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201137.753758:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b0001681000/0x72011f792b786b6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b786b65 expref: 19 pid: 5819 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201137.753771:0:11169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f39a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875064622461696:0@lo:104: 00000100:00100000:0.0:1788201137.753868:0:11169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201137.753940:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622461696 00000100:00100000:1.0:1788201137.753946:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622461696 00000100:00100000:1.0:1788201137.753978:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201137.753986:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+3:11169:x1875064622461696:12345-0@lo:104: 00010000:00010000:1.0:1788201137.753995:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0000/0x72011f792b786b65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786b6c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201137.754038:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201137.754054:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+3:11169:x1875064622461696:12345-0@lo:104: Request processed in 70us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201137.754060:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788201137.754481:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b004217d000/0x72011f792b786b7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b786b73 expref: 19 pid: 5821 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.754504:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201137.754551:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006799450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622461824:12345-0@lo:103:ldlm_bl.0 Request processed in 1813us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201137.754559:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1788201137.754624:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201137.754630:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0000/0x72011f792b786b65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786b6c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201137.754745:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622461824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201137.754786:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1788201137.754792:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0000/0x72011f792b786b65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b786b6c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.754801:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0000/0x72011f792b786b65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b786b6c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201137.754808:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0000/0x72011f792b786b65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b786b6c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201137.754814:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201137.754852:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0000/0x72011f792b786b65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786b6c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.754870:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201137.754890:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0000/0x72011f792b786b65 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786b6c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.754897:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0000/0x72011f792b786b65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786b6c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.754909:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201137.754910:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201137.754912:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201137.754922:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622461952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201137.754951:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201137.754987:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622461952 00000100:00100000:2.0:1788201137.754991:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622461952 00010000:00010000:2.0:1788201137.755009:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0001681000/0x72011f792b786b6c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786b65 expref: 19 pid: 5819 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201137.755029:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201137.755036:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f612d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622461952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201137.755045:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201137.755051:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0001681000/0x72011f792b786b6c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786b65 expref: 19 pid: 5819 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.755060:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0001681000/0x72011f792b786b6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b786b65 expref: 19 pid: 5819 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.755070:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201137.755096:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f612d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622461952:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201137.755108:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201137.755158:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622461952:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201137.762468:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b001f8f0200/0x72011f792b786b5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b786b57 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.762488:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b001f8f0200/0x72011f792b786b5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b786b57 expref: 18 pid: 5822 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201137.762507:0:11169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f27100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875064622462080:0@lo:104: 00000100:00100000:0.0:1788201137.762580:0:11169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201137.762937:0:11169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00081bc600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201137.762968:0:11169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006650a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875064622461312:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788201137.762981:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b004217d000/0x72011f792b786b7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b786b73 expref: 18 pid: 5821 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201137.762995:0:11169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f399880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875064622461568:0@lo:104: 00010000:00010000:0.0:1788201137.763004:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0001681000/0x72011f792b786b6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b786b65 expref: 17 pid: 5819 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201137.763013:0:11169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f39a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875064622461696:0@lo:104: 00000100:00100000:1.0:1788201137.764424:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622462080 00000100:00100000:1.0:1788201137.764436:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622462080 00000100:00100000:1.0:1788201137.764500:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201137.764510:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+3:11169:x1875064622462080:12345-0@lo:104: 00010000:00010000:1.0:1788201137.764525:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b0001681800/0x72011f792b786b57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786b5e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201137.764610:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201137.764617:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16f590af-689d-4459-b486-809c9db65822+3:11169:x1875064622462080:12345-0@lo:104: Request processed in 108us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201137.764623:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788201137.764658:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201137.764666:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0001681800/0x72011f792b786b57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786b5e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.764676:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681800 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1788201137.764681:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0001681800/0x72011f792b786b57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b786b5e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.764713:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0001681800/0x72011f792b786b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b786b5e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201137.764722:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0001681800/0x72011f792b786b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b786b5e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201137.764728:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201137.764766:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b0001681800/0x72011f792b786b57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786b5e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.764773:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201137.764796:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0001681800/0x72011f792b786b57 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786b5e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.764804:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0001681800/0x72011f792b786b57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786b5e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.764820:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201137.764823:0:11169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f27100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875064622462080:0@lo:104: 00010000:00010000:0.0:1788201137.764824:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201137.764827:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201137.765169:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201137.765251:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201137.765347:0:11169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006652d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875064622461440:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201137.765377:0:11169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0001681e00/0x72011f792b786bb2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201137.765473:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614041472 00000100:00100000:3.0:1788201137.765484:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614041472 00010000:00010000:3.0:1788201137.765510:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b000676ea00/0x72011f792b786b96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2cba expref: 13 pid: 5822 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201137.765540:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614041600 00000100:00100000:3.0:1788201137.765543:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614041600 00010000:00010000:3.0:1788201137.765556:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b004217da00/0x72011f792b786b81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c82 expref: 14 pid: 5821 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201137.765582:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:3.0:1788201137.765590:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79fcbf4-8d24-427b-827f-6b1cb026b088+14:2349:x1875064614041472:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201137.765601:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201137.765607:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b000676ea00/0x72011f792b786b96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2cba expref: 14 pid: 5822 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.765618:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b000676ea00/0x72011f792b786b96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2cba expref: 14 pid: 5822 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.765632:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b000676ea00/0x72011f792b786b96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2cba expref: 14 pid: 5822 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.765653:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201137.765692:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2349:x1875064614041472:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 103us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201137.765699:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:3.0:1788201137.765712:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:3.0:1788201137.765719:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:2349:x1875064614041600:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201137.765725:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201137.765729:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b004217da00/0x72011f792b786b81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c82 expref: 12 pid: 5821 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.765744:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b004217da00/0x72011f792b786b81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c82 expref: 12 pid: 5821 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.765754:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b004217da00/0x72011f792b786b81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c82 expref: 12 pid: 5821 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.765764:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201137.765782:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79fcbf4-8d24-427b-827f-6b1cb026b088+11:2349:x1875064614041600:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 64us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201137.765788:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:2.0:1788201137.766316:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622462208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201137.766352:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201137.766447:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622462208 00000100:00100000:3.0:1788201137.766451:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622462208 00010000:00010000:3.0:1788201137.766465:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b001f8f0200/0x72011f792b786b5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786b57 expref: 17 pid: 5822 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201137.766479:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788201137.766484:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+17:3295:x1875064622462208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201137.766492:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201137.766496:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b001f8f0200/0x72011f792b786b5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786b57 expref: 17 pid: 5822 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.766505:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b001f8f0200/0x72011f792b786b5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b786b57 expref: 17 pid: 5822 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.766516:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b001f8f0200/0x72011f792b786b5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b786b57 expref: 17 pid: 5822 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.766527:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0001681e00/0x72011f792b786bb2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.766541:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0001681e00/0x72011f792b786bb2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.766554:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0001681e00/0x72011f792b786bb2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.766560:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0001681e00/0x72011f792b786bb2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.766568:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0001681e00/0x72011f792b786bb2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.766575:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0001681e00/0x72011f792b786bb2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.766581:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681e00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201137.766585:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0001681e00/0x72011f792b786bb2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.766592:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0001681e00/0x72011f792b786bb2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.766603:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0001681e00/0x72011f792b786bb2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.766610:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201137.766646:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+16:3295:x1875064622462208:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201137.766652:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788201137.767283:0:11169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0001681e00/0x72011f792b786bb2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.767293:0:11169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0001681e00/0x72011f792b786bb2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.767300:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0001681e00/0x72011f792b786bb2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201137.771889:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622462208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201137.947054:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201137.947090:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201137.947114:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614041728 00000100:00100000:3.0:1788201137.947124:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614041728 00000100:00100000:3.0:1788201137.947234:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614041856 00000100:00100000:3.0:1788201137.947238:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614041856 00000100:00100000:0.0:1788201137.947247:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 76 00000100:00100000:0.0:1788201137.947260:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614041728:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201137.947269:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 77 00000100:00100000:3.0:1788201137.947279:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2349:x1875064614041856:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201137.947337:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614041728:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 80us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201137.947345:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 76 00000100:00100000:3.0:1788201137.949004:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2349:x1875064614041856:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 1718us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201137.949017:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 77 00000100:00080000:3.0:1788201137.949052:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788201138.635528:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201138.781012:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201138.781179:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614041984 00000100:00100000:0.0:1788201138.781198:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614041984 00000100:00100000:0.0:1788201138.781259:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 223 00000100:00100000:0.0:1788201138.781270:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+11:5588:x1875064614041984:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201138.781289:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201138.781310:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b000676fc00/0x72011f792b786bb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2ce4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201138.781339:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b000676fc00/0x72011f792b786bb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ce4 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201138.781350:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b000676fc00/0x72011f792b786bb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ce4 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201138.781359:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676fc00, rc 0) 00000100:00100000:0.0:1788201138.781409:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:5588:x1875064614041984:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 Request processed in 141us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201138.781416:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 223 00000100:00100000:0.0:1788201138.789538:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201138.789663:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614042112 00000100:00100000:3.0:1788201138.789681:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614042112 00000100:00100000:3.0:1788201138.789737:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 224 00000100:00100000:3.0:1788201138.789746:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:5588:x1875064614042112:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201138.790018:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:5588:x1875064614042112:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 Request processed in 272us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201138.790026:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 224 00000100:00100000:2.0:1788201138.794314:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201138.794438:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614042240 00000100:00100000:3.0:1788201138.794449:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614042240 00000100:00100000:3.0:1788201138.794511:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 225 00000100:00100000:3.0:1788201138.794522:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:5588:x1875064614042240:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201138.794751:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:5588:x1875064614042240:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 Request processed in 230us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201138.794769:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 225 00000100:00100000:2.0:1788201138.831590:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201138.833679:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614042368 00000100:00100000:0.0:1788201138.833700:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614042368 00000100:00100000:0.0:1788201138.833763:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 226 00000100:00100000:0.0:1788201138.833784:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:5588:x1875064614042368:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201138.833802:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201138.833822:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b000676e200/0x72011f792b786bc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2ceb expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201138.833852:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b000676e200/0x72011f792b786bc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ceb expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201138.833864:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b000676e200/0x72011f792b786bc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ceb expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201138.833873:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676e200, rc 0) 00000100:00100000:0.0:1788201138.833944:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:5588:x1875064614042368:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 Request processed in 163us (2363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201138.833951:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 226 00000100:00100000:0.0:1788201138.840420:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201138.841247:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614042496 00000100:00100000:3.0:1788201138.841258:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614042496 00000100:00100000:3.0:1788201138.841313:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 227 00000100:00100000:3.0:1788201138.841323:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:5588:x1875064614042496:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201138.841646:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:5588:x1875064614042496:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 Request processed in 323us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201138.841833:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 227 00000100:00100000:1.0:1788201138.846741:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201138.846829:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614042624 00000100:00100000:3.0:1788201138.846839:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614042624 00000100:00100000:3.0:1788201138.846896:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 228 00000100:00100000:3.0:1788201138.846906:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:5588:x1875064614042624:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201138.847244:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:5588:x1875064614042624:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 Request processed in 283us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201138.847253:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 228 00000100:00100000:2.0:1788201138.956323:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622462336:0@lo:400:kworker.0 00000100:00100000:2.0:1788201138.956390:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201138.956435:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622462848:0@lo:400:kworker.0 00000100:00100000:2.0:1788201138.956458:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201138.956480:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788201138.956485:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622462464:0@lo:400:kworker.0 00000100:00100000:2.0:1788201138.956504:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201138.956522:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622462976:0@lo:400:kworker.0 00000100:00100000:2.0:1788201138.956545:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201138.956569:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622462592:0@lo:400:kworker.0 00000100:00100000:2.0:1788201138.956590:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201138.956603:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201138.956608:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622462720:0@lo:400:kworker.0 00000100:00100000:2.0:1788201138.956628:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201138.956848:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622462976 00000100:00100000:3.0:1788201138.956854:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622462976 00000100:00100000:3.0:1788201138.956908:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622462720 00000100:00100000:3.0:1788201138.956911:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622462720 00000100:00100000:3.0:1788201138.956930:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201138.956947:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0008849850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622462976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201138.957000:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0008849850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622462976:12345-0@lo:400:kworker.0 Request processed in 62us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201138.957007:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201138.957173:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201138.957190:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622462720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201138.957226:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622462720:12345-0@lo:400:kworker.0 Request processed in 37us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201138.957233:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201138.957250:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622462848 00000100:00100000:3.0:1788201138.957254:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622462848 00000100:00100000:3.0:1788201138.957275:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622462464 00000100:00100000:3.0:1788201138.957278:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622462464 00000100:00100000:3.0:1788201138.957288:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622462592 00000100:00100000:3.0:1788201138.957291:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622462592 00000100:00100000:3.0:1788201138.957304:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788201138.957309:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622462848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201138.957339:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622462848:12345-0@lo:400:kworker.0 Request processed in 30us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201138.957345:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788201138.957355:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788201138.957361:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622462464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201138.957383:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622462464:12345-0@lo:400:kworker.0 Request processed in 23us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201138.957389:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788201138.957398:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788201138.957403:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622462592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201138.957424:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622462592:12345-0@lo:400:kworker.0 Request processed in 21us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201138.957430:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:3.0:1788201138.957462:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b003f612a00 x1875064622462720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201138.957487:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622462720:0@lo:400:kworker.0 00000100:00100000:3.0:1788201138.957500:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622462592:0@lo:400:kworker.0 00000100:00100000:3.0:1788201138.957527:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622462464:0@lo:400:kworker.0 00010000:00080000:3.0:1788201138.957536:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b003f613800 x1875064622462976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201138.957544:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622462976:0@lo:400:kworker.0 00000100:00100000:3.0:1788201138.957552:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622462848:0@lo:400:kworker.0 00000100:00100000:3.0:1788201138.957570:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622462336 00000100:00100000:3.0:1788201138.957573:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622462336 00000100:00100000:3.0:1788201138.957597:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788201138.957602:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+16:3292:x1875064622462336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201138.957633:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+16:3292:x1875064622462336:12345-0@lo:400:kworker.0 Request processed in 31us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201138.957639:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788201138.957665:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622462336:0@lo:400:kworker.0 00000100:00080000:2.0:1788201138.958219:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201138.958224:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201138.958226:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201138.958787:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201138.958879:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622463104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201138.958935:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201138.958972:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622463104 00000100:00100000:2.0:1788201138.958977:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622463104 00000100:00100000:2.0:1788201138.959007:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788201138.959256:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622463104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201138.959290:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201138.959349:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622463104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 335us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201138.959357:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788201138.959441:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b003f39a300 x1875064622463104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201138.959457:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622463104:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1788201139.408797:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788201139.408805:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b003f8e9800 from 7 10000000:01000000:1.0:1788201139.408810:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201139.408857:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001680000/0x72011f792b786bc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201139.408870:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0001680000/0x72011f792b786bc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201139.408893:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0001680000/0x72011f792b786bc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201139.408917:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f399880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622463232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201139.408981:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201139.409025:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00081bc480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201139.409071:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622463232 00000100:00100000:1.0:1788201139.409078:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622463232 00000100:00100000:1.0:1788201139.409126:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788201139.409169:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+16:5825:x1875064622463232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201139.409182:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201139.409195:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0001681600/0x72011f792b786bce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786bc7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201139.409217:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0001681600/0x72011f792b786bce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786bc7 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201139.409225:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0001681600/0x72011f792b786bce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786bc7 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201139.409234:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681600, rc 0) 00000100:00100000:1.0:1788201139.409271:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622463232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201139.409278:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788201139.409320:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f399880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622463232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201139.409333:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0001680000/0x72011f792b786bc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786bce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201139.409348:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0001680000/0x72011f792b786bc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786bce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201139.409409:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f399880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622463360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201139.409439:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201139.409459:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00081bc480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201139.416070:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622463360 00000100:00100000:2.0:1788201139.416085:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622463360 00000100:00100000:2.0:1788201139.416168:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788201139.416179:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622463360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201139.418844:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622463360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2658us (9394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201139.418856:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788201139.419746:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f399880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622463360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201139.419807:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f399880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622463488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201139.419861:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201139.419901:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00081bc480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201139.421016:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622463488 00000100:00100000:3.0:1788201139.421025:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622463488 00000100:00100000:3.0:1788201139.421086:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788201139.421096:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622463488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201139.421346:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622463488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 252us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201139.421354:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788201139.422496:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f399880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622463488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201139.433246:0:11211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788201139.439262:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788201139.439299:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201139.439310:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001680000/0x72011f792b786bc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786bce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201139.439324:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0001680000/0x72011f792b786bc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786bce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201139.439358:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788201139.439361:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b0010346000 from 7 10000000:01000000:1.0:1788201139.439364:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201139.439414:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681a00/0x72011f792b786bd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201139.439423:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0001681a00/0x72011f792b786bd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201139.439448:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0001681a00/0x72011f792b786bd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201139.439472:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f39aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622463616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201139.439548:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201139.439858:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622463616 00000100:00100000:2.0:1788201139.439867:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622463616 00000100:00100000:2.0:1788201139.439956:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788201139.439966:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622463616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201139.439979:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201139.439992:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b001f8f1a00/0x72011f792b786bdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786bd5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201139.440015:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b001f8f1a00/0x72011f792b786bdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786bd5 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201139.440024:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b001f8f1a00/0x72011f792b786bdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786bd5 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201139.440039:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1a00, rc 0) 00000100:00100000:2.0:1788201139.440074:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622463616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201139.440081:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788201139.440176:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00081bc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201139.440198:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f39aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622463616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201139.440211:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0001681a00/0x72011f792b786bd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786bdc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201139.440220:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0001681a00/0x72011f792b786bd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786bdc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201139.440268:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f39aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622463744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201139.440294:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201139.440314:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00081bc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201139.440433:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622463744 00000100:00100000:2.0:1788201139.440438:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622463744 00000100:00100000:2.0:1788201139.440469:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788201139.440476:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622463744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201139.440924:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622463744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 446us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201139.440931:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788201139.440965:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f39aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622463744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201139.440996:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027576a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622463872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201139.441036:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201139.441056:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0011e35240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201139.441067:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622463872 00000100:00100000:2.0:1788201139.441071:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622463872 00000100:00100000:2.0:1788201139.441091:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788201139.441098:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622463872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201139.441271:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622463872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201139.441278:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788201139.441321:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027576a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622463872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201139.446275:0:11212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788201139.456412:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788201139.456453:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201139.456464:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681a00/0x72011f792b786bd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786bdc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201139.456476:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0001681a00/0x72011f792b786bd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786bdc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201139.456486:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788201139.456488:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b0007c1d000 from 7 10000000:01000000:2.0:1788201139.456491:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201139.456524:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1000/0x72011f792b786be3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201139.456532:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1000/0x72011f792b786be3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201139.456542:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1000/0x72011f792b786be3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201139.456577:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0027576a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622464000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201139.456732:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201139.456777:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0011e35240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201139.457235:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622464000 00000100:00100000:3.0:1788201139.457242:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622464000 00000100:00100000:3.0:1788201139.457296:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788201139.457305:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622464000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201139.457317:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201139.457331:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b00126fdc00/0x72011f792b786bea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786be3 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201139.457353:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00126fdc00/0x72011f792b786bea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786be3 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201139.457362:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b00126fdc00/0x72011f792b786bea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786be3 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201139.457370:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fdc00, rc 0) 00000100:00100000:3.0:1788201139.457412:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622464000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201139.457419:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788201139.457460:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0027576a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622464000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201139.457473:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1000/0x72011f792b786be3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786bea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201139.457492:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1000/0x72011f792b786be3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786bea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201139.457543:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622464128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201139.457570:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201139.457605:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00100b4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201139.457619:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622464128 00000100:00100000:3.0:1788201139.457622:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622464128 00000100:00100000:3.0:1788201139.457642:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788201139.457647:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622464128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201139.457874:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622464128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201139.457881:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788201139.457912:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622464128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201139.457938:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622464256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201139.457974:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201139.457987:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00100b4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201139.457998:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622464256 00000100:00100000:3.0:1788201139.458001:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622464256 00000100:00100000:3.0:1788201139.458019:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788201139.458024:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622464256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201139.458193:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622464256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201139.458199:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788201139.458242:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622464256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201139.466559:0:11216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788201139.466951:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788201139.466971:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201139.466982:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1000/0x72011f792b786be3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786bea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201139.466994:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1000/0x72011f792b786be3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786bea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201139.665525:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201139.979439:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622464384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201139.979507:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201139.979704:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622464384 00000100:00100000:1.0:1788201139.979712:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622464384 00000100:00100000:1.0:1788201139.979763:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201139.979773:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622464384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201139.979807:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201139.979859:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622464384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201139.979866:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788201139.979930:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b003f39ad80 x1875064622464384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201139.979948:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622464384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201140.683294:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201141.709202:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201142.055564:0:11367:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788201142.731769:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201143.070723:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201143.070775:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201143.070813:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201143.070965:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614043008 00000100:00100000:1.0:1788201143.070975:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614043008 00000100:00100000:1.0:1788201143.071034:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614042880 00000100:00100000:1.0:1788201143.071037:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614042880 00000100:00100000:1.0:1788201143.071063:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 81 00000100:00100000:1.0:1788201143.071073:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2349:x1875064614043008:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201143.071180:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2349:x1875064614043008:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 108us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201143.071187:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 81 00000100:00100000:1.0:1788201143.071205:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 82 00000100:00100000:1.0:1788201143.071211:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614042880:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201143.071235:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614042880:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 24us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201143.071241:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 82 00000100:00100000:3.0:1788201143.072163:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614042752 00000100:00100000:3.0:1788201143.072171:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614042752 00000100:00100000:3.0:1788201143.072222:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 239 00000100:00100000:3.0:1788201143.072230:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2349:x1875064614042752:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201143.072281:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2349:x1875064614042752:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 53us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201143.072288:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 239 00000100:00080000:2.0:1788201143.072735:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201143.756290:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201144.077270:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622464512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201144.077370:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201144.077710:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622464512 00000100:00100000:1.0:1788201144.077720:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622464512 00000100:00100000:1.0:1788201144.077797:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201144.077808:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622464512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201144.077856:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201144.077911:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622464512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201144.077919:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788201144.077969:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b003f398e00 x1875064622464512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201144.077993:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622464512:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788201144.078736:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201144.078739:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622464640:0@lo:400:kworker.0 00000100:00100000:0.0:1788201144.078802:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201144.078827:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622464768:0@lo:400:kworker.0 00000100:00100000:0.0:1788201144.078831:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622465152:0@lo:400:kworker.0 00000100:00100000:0.0:1788201144.078859:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201144.078869:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622464896:0@lo:400:kworker.0 00000100:00100000:0.0:1788201144.078884:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201144.078889:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622465024:0@lo:400:kworker.0 00000100:00100000:1.0:1788201144.078894:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201144.078923:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201144.078929:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622465152 00000100:00100000:1.0:1788201144.078934:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622465152 00000100:00100000:0.0:1788201144.078949:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622464896 00000100:00100000:0.0:1788201144.078953:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622464896 00000100:00100000:1.0:1788201144.078975:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788201144.078980:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788201144.078983:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622465152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201144.078985:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622464896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201144.079027:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622465152:12345-0@lo:400:kworker.0 Request processed in 44us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201144.079027:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622464896:12345-0@lo:400:kworker.0 Request processed in 40us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201144.079034:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788201144.079078:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622464640 00000100:00100000:2.0:1788201144.079081:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622464640 00000100:00100000:2.0:1788201144.079150:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788201144.079157:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622464640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201144.079190:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622464640:12345-0@lo:400:kworker.0 Request processed in 35us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201144.079196:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788201144.079570:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788201144.079593:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622465024 00000100:00100000:0.0:1788201144.079597:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622465024 00000100:00100000:0.0:1788201144.079626:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788201144.079632:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622465024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201144.079667:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622465024:12345-0@lo:400:kworker.0 Request processed in 35us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201144.079673:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788201144.080608:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201144.080615:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788201144.080663:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b003f398000 x1875064622465024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201144.080680:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622465024:0@lo:400:kworker.0 00000100:00100000:2.0:1788201144.080691:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622464640:0@lo:400:kworker.0 00000100:00100000:2.0:1788201144.080702:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622465152:0@lo:400:kworker.0 00000100:00100000:0.0:1788201144.081220:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201144.081288:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622464896:0@lo:400:kworker.0 00000100:00100000:2.0:1788201144.081364:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622464768 00000100:00100000:2.0:1788201144.081371:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622464768 00000100:00100000:2.0:1788201144.081427:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788201144.081435:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622464768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201144.081523:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622464768:12345-0@lo:400:kworker.0 Request processed in 88us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201144.081531:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788201144.081568:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622464768:0@lo:400:kworker.0 00010000:00010000:1.0:1788201144.784214:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201145.103875:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201145.103914:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622465280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201145.104127:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201145.104298:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622465280 00000100:00100000:1.0:1788201145.104309:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622465280 00000100:00100000:1.0:1788201145.104372:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788201145.104468:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622465280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201145.104517:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201145.104586:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622465280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201145.104594:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788201145.104801:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b003f399f80 x1875064622465280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201145.104824:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622465280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201145.805349:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201146.807867:0:11468:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 14:32:25 (1788201145) === 00010000:00010000:0.0:1788201146.830001:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201147.405413:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201147.405463:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201147.405561:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614043136 00000100:00100000:1.0:1788201147.405571:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614043136 00000100:00100000:1.0:1788201147.405641:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:1.0:1788201147.405652:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2348:x1875064614043136:12345-192.168.203.14@tcp:41:mkdir.0 00000004:00000024:1.0:1788201147.405697:0:5827:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788201147.405775:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2348:x1875064614043136:12345-192.168.203.14@tcp:41:mkdir.0 Request processed in 126us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201147.405796:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00080000:2.0:1788201147.406625:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201147.406921:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614043264 00000100:00100000:3.0:1788201147.406929:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614043264 00000100:00100000:3.0:1788201147.406979:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:3.0:1788201147.406988:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:9665:x1875064614043264:12345-192.168.203.14@tcp:700:mkdir.0 00000100:00100000:3.0:1788201147.407449:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:9665:x1875064614043264:12345-192.168.203.14@tcp:700:mkdir.0 Request processed in 460us (2043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201147.407466:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:2.0:1788201147.426869:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201147.427781:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614043520 00000100:00100000:0.0:1788201147.427793:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614043520 00000100:00100000:0.0:1788201147.427881:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:0.0:1788201147.427892:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003593b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:9665:x1875064614043520:12345-192.168.203.14@tcp:36:mkdir.0 00010000:00010000:0.0:1788201147.427954:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201147.427997:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fce00/0x72011f792b786ad2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c6d expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.428018:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00109a1100) 00010000:00010000:0.0:1788201147.428030:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201147.428427:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786bf1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.428441:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786bf1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.428451:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786bf1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.428918:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b786bf8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.428928:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b786bf8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.428935:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b786bf8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201147.453029:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788201147.453052:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786bf1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.453063:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786bf1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.453089:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786bf1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.453105:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201147.453109:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786bf1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.453150:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786bf1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.453168:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0002a80e00) 00010000:00010000:0.0:1788201147.453171:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201147.453176:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786bf1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.453182:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786bf1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201147.453207:0:5828:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ed46695 reply state 000000003805dc32 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b786bf8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201147.453217:0:5828:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201147.455078:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003593b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:9665:x1875064614043520:12345-192.168.203.14@tcp:36:mkdir.0 Request processed in 27178us (28220us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788201147.455099:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 15 00010000:00010000:3.0:1788201147.471023:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b786bf8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.471040:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b786bf8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.471059:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b786bf8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.471065:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201147.471070:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b786bf8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.471078:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b786bf8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.471103:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b0002a80100) 00010000:00010000:3.0:1788201147.471107:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201147.471113:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b786bf8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.471119:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b786bf8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201147.492572:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201147.492937:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614043648 00000100:00100000:1.0:1788201147.492948:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614043648 00000100:00100000:1.0:1788201147.493010:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:1.0:1788201147.493021:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003593aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:9666:x1875064614043648:12345-192.168.203.14@tcp:101:chmod.0 00010000:00010000:1.0:1788201147.493045:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201147.493071:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b786bff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2cf2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.493384:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786c06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.493399:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786c06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.493413:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786c06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201147.500372:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788201147.500384:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201147.500636:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786c06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.502804:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b786bff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2cf2 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.502842:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786c06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2cf2 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.502852:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00033b2800) 00010000:00010000:2.0:1788201147.502855:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201147.502859:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681800, rc 0) 00000100:00100000:2.0:1788201147.503012:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003593aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:9666:x1875064614043648:12345-192.168.203.14@tcp:101:chmod.0 Request processed in 9991us (10448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201147.503022:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:1.0:1788201147.510294:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201147.510382:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614043904 00000100:00100000:0.0:1788201147.510409:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614043904 00000100:00100000:0.0:1788201147.510666:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:0.0:1788201147.510678:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:9666:x1875064614043904:12345-192.168.203.14@tcp:36:chmod.0 00010000:00010000:0.0:1788201147.510749:0:9471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201147.510776:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786c06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2cf2 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.510796:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00033b2800) 00010000:00010000:0.0:1788201147.510806:0:9471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201147.510831:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786c0d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.510843:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786c0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.510852:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786c0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201147.511219:0:9471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058c5573a reply state 00000000d61f17ff transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786c0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201147.511229:0:9471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788201147.511245:0:9471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1788201147.511341:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:9666:x1875064614043904:12345-192.168.203.14@tcp:36:chmod.0 Request processed in 665us (1061us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788201147.511349:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 17 00010000:00010000:3.0:1788201147.516810:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786c0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.516834:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786c0d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.516909:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786c0d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.516917:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201147.516923:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786c0d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.516957:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786c0d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.516979:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0002a80e00) 00010000:00010000:3.0:1788201147.516982:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201147.516994:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786c0d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.517002:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786c0d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201147.533272:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201147.534905:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614044032 00000100:00100000:0.0:1788201147.534922:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614044032 00000100:00100000:0.0:1788201147.534996:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:0.0:1788201147.535007:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:9667:x1875064614044032:12345-192.168.203.14@tcp:101:chown.0 00010000:00010000:0.0:1788201147.535031:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201147.535055:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786c14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2cf9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.535191:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b786c1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.535207:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b786c1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.535219:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b786c1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201147.535283:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788201147.535287:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201147.535342:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b786c1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.535368:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786c14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2cf9 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.535389:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b786c1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2cf9 expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.535397:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201147.535400:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201147.535404:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676f600, rc 0) 00000100:00100000:0.0:1788201147.535461:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:9667:x1875064614044032:12345-192.168.203.14@tcp:101:chown.0 Request processed in 455us (2203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201147.535468:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:1.0:1788201147.544612:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201147.545063:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614044160 00000100:00100000:2.0:1788201147.545088:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614044160 00000100:00100000:2.0:1788201147.545203:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:2.0:1788201147.545215:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:9667:x1875064614044160:12345-192.168.203.14@tcp:101:chown.0 00010000:00010000:2.0:1788201147.545236:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201147.545259:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786c22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d00 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545326:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545341:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545353:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545367:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545374:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545380:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545480:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786c37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545489:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786c37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545496:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786c37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201147.545539:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788201147.545543:0:5828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201147.545566:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786c37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545578:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545585:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c29 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545592:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545598:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201147.545602:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545610:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545621:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:2.0:1788201147.545624:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201147.545628:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545634:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545799:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545817:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545823:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545829:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201147.545832:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545838:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545846:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b0011cb3500) 00010000:00010000:2.0:1788201147.545849:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201147.545852:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545857:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545887:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786c22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d00 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545899:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786c37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d00 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.545906:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b0011cb3e00) 00010000:00010000:2.0:1788201147.545909:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201147.545919:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0000, rc 0) 00000100:00100000:2.0:1788201147.545986:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:9667:x1875064614044160:12345-192.168.203.14@tcp:101:chown.0 Request processed in 773us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201147.545993:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:1.0:1788201147.551061:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201147.551172:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614044416 00000100:00100000:0.0:1788201147.551183:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614044416 00000100:00100000:0.0:1788201147.551262:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:0.0:1788201147.551273:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:9667:x1875064614044416:12345-192.168.203.14@tcp:36:chown.0 00010000:00010000:0.0:1788201147.551332:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201147.551359:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786c37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d00 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.551380:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b0011cb3e00) 00010000:00010000:0.0:1788201147.551390:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201147.551426:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786c3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.551440:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786c3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.551449:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786c3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201147.672886:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080d35337 reply state 00000000bd23a6fd transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786c3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201147.672905:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788201147.673051:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1788201147.673377:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+10:9667:x1875064614044416:12345-192.168.203.14@tcp:36:chown.0 Request processed in 122101us (122320us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788201147.673387:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 20 00000001:00080000:0.0:1788201147.673430:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:3.0:1788201147.675651:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786c3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.675668:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786c3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.675675:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786c3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.675682:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676fe00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201147.675686:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786c3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.675694:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786c3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.675712:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b0002a80500) 00010000:00010000:3.0:1788201147.675715:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201147.675720:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786c3e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.675749:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786c3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201147.693944:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201147.694130:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614044544 00000100:00100000:2.0:1788201147.694184:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614044544 00000100:00100000:2.0:1788201147.694238:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:2.0:1788201147.694249:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f39b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:9668:x1875064614044544:12345-192.168.203.14@tcp:101:touch.500 00010000:00010000:2.0:1788201147.694277:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201147.694359:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786c45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d07 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201147.709160:0:5828:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 14380us 00010000:00010000:2.0:1788201147.738295:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.738320:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.738332:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.738348:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.738355:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.738362:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.738842:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b786c5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.738858:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b786c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.738865:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b786c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201147.738959:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788201147.738964:0:5828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201147.739058:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b786c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.739071:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.739078:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.739086:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.739104:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201147.739108:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.739115:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.739128:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:2.0:1788201147.739131:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201147.739155:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.739172:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0a00/0x72011f792b786c4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.739185:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.739192:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.739198:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.739203:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201147.739206:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.739212:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.739221:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b0011cb3500) 00010000:00010000:2.0:1788201147.739223:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201147.739226:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.739231:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.739269:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786c45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d07 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.739283:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b786c5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d07 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.739297:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b0011cb3100) 00010000:00010000:2.0:1788201147.739299:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788201147.739302:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0200, rc 0) 00000100:00100000:2.0:1788201147.739379:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f39b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:9668:x1875064614044544:12345-192.168.203.14@tcp:101:touch.500 Request processed in 45131us (45445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201147.739388:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:1.0:1788201147.758035:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201147.758108:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614044800 00000100:00100000:2.0:1788201147.758127:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614044800 00000100:00100000:0.0:1788201147.758290:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:0.0:1788201147.758303:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:9668:x1875064614044800:12345-192.168.203.14@tcp:101:touch.500 00010000:00010000:0.0:1788201147.758343:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201147.758367:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b786c61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d0e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.758934:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b786c68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.758949:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b786c68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.758959:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b786c68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.758997:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786c6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.759004:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786c6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.759011:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786c6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201147.768014:0:5829:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788201147.768769:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786c76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.768788:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786c76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.768807:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786c76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.768848:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b786c68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.768856:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b786c68 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.768863:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b786c68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.768869:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676e800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201147.768873:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b786c68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.768881:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b786c68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.768894:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b0011cb3100) 00010000:00010000:1.0:1788201147.768897:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201147.768901:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b786c68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.768907:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b786c68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201147.768922:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a11d8aa reply state 00000000055f42be transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786c6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201147.768931:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201147.768977:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b786c61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d0e expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.768993:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786c76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d0e expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.769001:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b00033b2100) 00010000:00010000:1.0:1788201147.769004:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201147.769006:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680600, rc 0) 00000100:00100000:1.0:1788201147.769101:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+10:9668:x1875064614044800:12345-192.168.203.14@tcp:101:touch.500 Request processed in 10792us (11068us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788201147.769110:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 22 00010000:00010000:3.0:1788201147.773116:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786c6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.773207:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786c6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.773216:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786c6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.773222:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676e000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201147.773227:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786c6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.773235:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786c6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.773251:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb0620c33 (ffff9b0002a80e00) 00010000:00010000:3.0:1788201147.773254:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201147.773258:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786c6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.773265:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786c6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201147.781002:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201147.781166:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614045056 00000100:00100000:0.0:1788201147.781176:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614045056 00000100:00100000:0.0:1788201147.781239:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:0.0:1788201147.781250:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:9668:x1875064614045056:12345-192.168.203.14@tcp:36:touch.500 00010000:00010000:0.0:1788201147.781306:0:9471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201147.781334:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786c76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d0e expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.781371:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b00033b2100) 00010000:00010000:0.0:1788201147.781381:0:9471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201147.781453:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786c84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.781471:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786c84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201147.781480:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786c84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201147.781624:0:9471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080672a80 reply state 0000000073758674 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786c84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201147.781633:0:9471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201147.781727:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+10:9668:x1875064614045056:12345-192.168.203.14@tcp:36:touch.500 Request processed in 479us (732us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788201147.781738:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 23 00010000:00010000:3.0:1788201147.785767:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786c84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.785784:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786c84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.785806:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786c84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.785813:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676e400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201147.785818:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786c84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.785826:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786c84 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.785843:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b0002a80800) 00010000:00010000:3.0:1788201147.785846:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201147.785851:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786c84 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.785857:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786c84 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201147.790049:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201147.790169:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614045184 00000100:00100000:2.0:1788201147.790178:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614045184 00000100:00100000:2.0:1788201147.790267:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:2.0:1788201147.790276:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:9668:x1875064614045184:12345-192.168.203.14@tcp:101:touch.500 00010000:00010000:2.0:1788201147.790299:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201147.790321:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d15 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.790379:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d15 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.790393:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d15 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.790421:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b0011cb3500) 00010000:00010000:2.0:1788201147.790425:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201147.790429:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0400, rc 0) 00000100:00100000:2.0:1788201147.790501:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+10:9668:x1875064614045184:12345-192.168.203.14@tcp:101:touch.500 Request processed in 224us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201147.790522:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:0.0:1788201147.794961:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201147.795123:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614045312 00000100:00100000:3.0:1788201147.795163:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614045312 00000100:00100000:3.0:1788201147.795205:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:3.0:1788201147.795213:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2347:x1875064614045312:12345-192.168.203.14@tcp:8:touch.500 00010000:00080000:3.0:1788201147.795248:0:7765:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:3.0:1788201147.795285:0:7765:0:(genops.c:1406:class_connect()) connect: client aa6eef1a-3f03-469a-ac4c-2a406b6709bc, cookie 0x72011f792b786c92 00002000:00100000:3.0:1788201147.795300:0:7765:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aa6eef1a-3f03-469a-ac4c-2a406b6709bc/ffff9b003f461000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788201147.795326:0:7765:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788201147.795790:0:7765:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788201147.795823:0:7765:0:(import.c:65:import_set_state_nolock()) ffff9b003f466800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201147.795997:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2347:x1875064614045312:12345-192.168.203.14@tcp:8:touch.500 Request processed in 781us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201147.796006:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:3.0:1788201147.799932:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201147.800125:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614045440 00000100:00100000:0.0:1788201147.800189:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614045440 00000100:00100000:0.0:1788201147.800255:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:0.0:1788201147.800264:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:0:x1875064614045440:12345-192.168.203.14@tcp:2:touch.500 00000100:00080000:1.0:1788201147.803291:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201147.850539:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:0:x1875064614045440:12345-192.168.203.14@tcp:2:touch.500 Request processed in 50263us (50602us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788201147.850552:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 17 00000001:00080000:1.0:1788201147.852935:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1788201147.852960:0:6702:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa6eef1a-3f03-469a-ac4c-2a406b6709bc 00000100:00100000:3.0:1788201147.856118:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201147.856179:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614045696 00000100:00100000:3.0:1788201147.856190:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614045696 00000100:00100000:3.0:1788201147.856244:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:3.0:1788201147.856255:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+10:9668:x1875064614045696:12345-192.168.203.14@tcp:35:touch.500 00000100:00100000:3.0:1788201147.859078:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+11:9668:x1875064614045696:12345-192.168.203.14@tcp:35:touch.500 Request processed in 2814us (2959us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788201147.859101:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 2 00010000:00010000:1.0:1788201147.860012:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201147.908526:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201147.908920:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614045824 00000100:00100000:0.0:1788201147.908946:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614045824 00000100:00100000:0.0:1788201147.909009:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:0.0:1788201147.909020:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+11:9669:x1875064614045824:12345-192.168.203.14@tcp:101:rm.0 00010000:00010000:0.0:1788201147.909049:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201147.909071:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786c99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d1c expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.910542:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681000/0x72011f792b786ca0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.910563:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681000/0x72011f792b786ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.910577:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681000/0x72011f792b786ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201147.910639:0:9471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788201147.910643:0:9471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201147.910838:0:9471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681000/0x72011f792b786ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.910898:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786c99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d1c expref: 13 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.910920:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681000/0x72011f792b786ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d1c expref: 12 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.910929:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b0011cb3100) 00010000:00010000:1.0:1788201147.910931:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201147.910935:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681000, rc 0) 00000100:00100000:1.0:1788201147.911014:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+12:9669:x1875064614045824:12345-192.168.203.14@tcp:101:rm.0 Request processed in 1995us (2497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201147.911022:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:3.0:1788201147.917713:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201147.917864:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614046080 00000100:00100000:1.0:1788201147.917874:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614046080 00000100:00100000:1.0:1788201147.917942:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:1.0:1788201147.917952:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+12:9669:x1875064614046080:12345-192.168.203.14@tcp:101:rm.0 00010000:00010000:1.0:1788201147.917973:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201147.917993:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681400/0x72011f792b786ca7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d23 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201147.918109:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1788201147.919627:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681400/0x72011f792b786ca7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d23 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.919646:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:1.0:1788201147.919649:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201147.919667:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681400/0x72011f792b786ca7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d23 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.919750:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681400, rc 0) 00000100:00100000:1.0:1788201147.919855:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:9669:x1875064614046080:12345-192.168.203.14@tcp:101:rm.0 Request processed in 1904us (2151us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788201147.919864:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:3.0:1788201147.925972:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201147.926557:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614046208 00000100:00100000:0.0:1788201147.926568:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614046208 00000100:00100000:0.0:1788201147.926629:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:0.0:1788201147.926640:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:9669:x1875064614046208:12345-192.168.203.14@tcp:37:rm.0 00000100:00100000:1.0:1788201147.934902:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:9669:x1875064614046208:12345-192.168.203.14@tcp:37:rm.0 Request processed in 8253us (8928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201147.934916:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:0.0:1788201147.940109:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201147.940285:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614046464 00000100:00100000:3.0:1788201147.940295:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614046464 00000100:00100000:3.0:1788201147.940350:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:3.0:1788201147.940360:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00228e2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:9669:x1875064614046464:12345-192.168.203.14@tcp:35:rm.0 00000100:00100000:3.0:1788201147.941018:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00228e2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:9669:x1875064614046464:12345-192.168.203.14@tcp:35:rm.0 Request processed in 656us (925us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788201147.941027:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:0.0:1788201147.949913:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201147.949997:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614046720 00000100:00100000:2.0:1788201147.950007:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614046720 00000100:00100000:2.0:1788201147.950067:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:2.0:1788201147.950077:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:9669:x1875064614046720:12345-192.168.203.14@tcp:101:rm.0 00010000:00010000:2.0:1788201147.950111:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201147.950163:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b786cb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d2a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.950294:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b786cbc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.950320:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b786cbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.950332:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b786cbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201147.950343:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788201147.950654:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b786cb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d2a expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.950675:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b786cbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d2a expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.950757:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b0011cb3100) 00010000:00010000:2.0:1788201147.950760:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788201147.950778:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0600, rc 0) 00000100:00100000:2.0:1788201147.950829:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+16:9669:x1875064614046720:12345-192.168.203.14@tcp:101:rm.0 Request processed in 754us (927us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788201147.950837:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:2.0:1788201147.954924:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201147.955064:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614046848 00000100:00100000:3.0:1788201147.955074:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614046848 00000100:00100000:3.0:1788201147.955166:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:3.0:1788201147.955176:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+16:9669:x1875064614046848:12345-192.168.203.14@tcp:41:rm.0 00000004:00000024:3.0:1788201147.955240:0:5827:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788201147.955337:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+16:9669:x1875064614046848:12345-192.168.203.14@tcp:41:rm.0 Request processed in 162us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201147.955344:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:0.0:1788201147.960355:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201147.961476:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614046976 00000100:00100000:2.0:1788201147.961489:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614046976 00000100:00100000:2.0:1788201147.961558:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:2.0:1788201147.961568:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+16:9669:x1875064614046976:12345-192.168.203.14@tcp:101:rm.0 00010000:00010000:2.0:1788201147.961590:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201147.961610:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b786cca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d31 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.961676:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786cd1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.963346:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786cd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.963361:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786cd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.963398:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786cd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.963407:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.963414:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.964645:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1c00/0x72011f792b786cdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.964662:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1c00/0x72011f792b786cdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.964673:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1c00/0x72011f792b786cdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201147.964861:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788201147.964866:0:5828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201147.964962:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1c00/0x72011f792b786cdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.964975:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1c00/0x72011f792b786cdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.964983:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786cd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.964989:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786cd1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.964994:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786cd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.965000:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201147.965004:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786cd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.965011:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786cd1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.965040:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b0011cb3100) 00010000:00010000:2.0:1788201147.965044:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201147.965048:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786cd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.965054:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786cd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.965069:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.965075:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786cd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.965080:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.965084:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201147.965097:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.965104:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786cd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.965112:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb0620c33 (ffff9b0011cb3d00) 00010000:00010000:2.0:1788201147.965114:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201147.965117:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786cd8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.965122:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786cd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.965793:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b786cca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d31 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.965809:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1c00/0x72011f792b786cdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d31 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.965818:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b0011cb3500) 00010000:00010000:2.0:1788201147.965820:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201147.965823:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1c00, rc 0) 00000100:00100000:2.0:1788201147.965921:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+17:9669:x1875064614046976:12345-192.168.203.14@tcp:101:rm.0 Request processed in 4353us (5575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201147.965932:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:2.0:1788201147.973316:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201147.973423:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614047232 00000100:00100000:3.0:1788201147.973434:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614047232 00000100:00100000:3.0:1788201147.973491:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00100000:3.0:1788201147.973501:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003593b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+17:9669:x1875064614047232:12345-192.168.203.14@tcp:36:rm.0 00010000:00010000:3.0:1788201147.973558:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788201147.973585:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1c00/0x72011f792b786cdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d31 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.973610:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0400/0x72011f792b786c8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d15 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.973621:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b0011cb3500) 00010000:00010000:3.0:1788201147.973636:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681000/0x72011f792b786ca0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d1c expref: 15 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.973644:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b0011cb3100) 00010000:00010000:3.0:1788201147.973648:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201147.973665:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786ce6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.973678:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786ce6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.973699:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786ce6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.973742:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786ced lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.973751:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786ced lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.973757:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786ced lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.973912:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fde00/0x72011f792b786cf4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.973921:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fde00/0x72011f792b786cf4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.973929:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fde00/0x72011f792b786cf4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201147.974676:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788201147.974689:0:5827:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 227099554808ns, next at 228099552372ns, rc = 0 00010000:00010000:3.0:1788201147.974751:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786cfb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974762:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786cfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974770:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786cfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974777:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786cfb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974794:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786cfb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974800:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786cfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974827:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201147.974850:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fde00/0x72011f792b786cf4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974856:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fde00/0x72011f792b786cf4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974863:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fde00/0x72011f792b786cf4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974869:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fde00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201147.974874:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fde00/0x72011f792b786cf4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974882:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fde00/0x72011f792b786cf4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974892:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b00109a1500) 00010000:00010000:3.0:1788201147.974895:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201147.974900:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fde00/0x72011f792b786cf4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974906:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fde00/0x72011f792b786cf4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974924:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786ce6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974937:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786ce6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974943:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786ce6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974949:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fc200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201147.974952:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786ce6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974959:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786ce6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974967:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b0011cb3100) 00010000:00010000:3.0:1788201147.974970:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201147.974973:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786ce6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.974978:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786ce6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201147.974989:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e88e55b2 reply state 000000005d3e7b76 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786ced lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201147.974996:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201147.975078:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003593b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+16:9669:x1875064614047232:12345-192.168.203.14@tcp:36:rm.0 Request processed in 1575us (1780us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788201147.975101:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 30 00010000:00010000:2.0:1788201147.976068:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201147.976079:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786cfb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.976098:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fcc00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:2.0:1788201147.976102:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786cfb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.976111:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786cfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.976125:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b00109a1500) 00010000:00010000:2.0:1788201147.976127:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201147.976131:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786cfb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.976178:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786cfb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201147.976201:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201147.976203:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201147.976205:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201147.982223:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786ced lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.982261:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786ced lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.982280:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786ced lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.982286:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fd400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201147.982290:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786ced lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.982305:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786ced lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.982323:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb0620c33 (ffff9b00109a1000) 00010000:00010000:3.0:1788201147.982326:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201147.982330:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786ced lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.982336:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786ced lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201147.983777:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201147.984044:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614047488 00000100:00100000:3.0:1788201147.984053:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614047488 00000100:00100000:3.0:1788201147.984120:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:3.0:1788201147.984130:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:9669:x1875064614047488:12345-192.168.203.14@tcp:35:rm.0 00000100:00100000:3.0:1788201147.985037:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+16:9669:x1875064614047488:12345-192.168.203.14@tcp:35:rm.0 Request processed in 904us (1264us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788201147.985047:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:2.0:1788201147.992558:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201147.992745:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614047744 00000100:00100000:1.0:1788201147.992756:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614047744 00000100:00100000:1.0:1788201147.992815:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 31 00000100:00100000:1.0:1788201147.992825:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+16:9669:x1875064614047744:12345-192.168.203.14@tcp:36:rm.0 00010000:00010000:1.0:1788201147.992893:0:9471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788201147.992921:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b786cbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d2a expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.992943:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b786c5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d07 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.992953:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b0011cb3100) 00010000:00010000:1.0:1788201147.992968:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b786c1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2cf9 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.992977:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:1.0:1788201147.992983:0:9471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201147.993047:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681400/0x72011f792b786d02 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.993062:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681400/0x72011f792b786d02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.993071:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681400/0x72011f792b786d02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.993084:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681000/0x72011f792b786d09 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.993101:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681000/0x72011f792b786d09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.993108:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681000/0x72011f792b786d09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.993487:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786d10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.993496:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786d10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.993503:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786d10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201147.994129:0:9471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1788201147.994175:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786d10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.994183:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786d10 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.994201:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786d10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.994209:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201147.994214:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786d10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.994223:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786d10 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.994234:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b00033b2d00) 00010000:00010000:1.0:1788201147.994237:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201147.994240:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786d10 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.994247:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786d10 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.994267:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681400/0x72011f792b786d02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.994274:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681400/0x72011f792b786d02 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.994280:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681400/0x72011f792b786d02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.994286:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201147.994289:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681400/0x72011f792b786d02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.994305:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681400/0x72011f792b786d02 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.994315:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00033b2200) 00010000:00010000:1.0:1788201147.994317:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201147.994321:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681400/0x72011f792b786d02 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201147.994327:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681400/0x72011f792b786d02 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201147.994341:0:9471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051758645 reply state 00000000c5ec86a5 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681000/0x72011f792b786d09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201147.994350:0:9471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201147.994428:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:9669:x1875064614047744:12345-192.168.203.14@tcp:36:rm.0 Request processed in 1602us (1877us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788201147.994437:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 31 00010000:00010000:3.0:1788201147.997067:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681000/0x72011f792b786d09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.997109:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681000/0x72011f792b786d09 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.997118:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681000/0x72011f792b786d09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.997124:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201147.997130:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681000/0x72011f792b786d09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.997175:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681000/0x72011f792b786d09 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.997191:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b00033b2000) 00010000:00010000:3.0:1788201147.997195:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201147.997199:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681000/0x72011f792b786d09 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201147.997205:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681000/0x72011f792b786d09 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201148.188922:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201148.189020:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201148.189398:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614047872 00000100:00100000:0.0:1788201148.189409:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614047872 00000100:00100000:0.0:1788201148.189479:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 241 00000100:00100000:0.0:1788201148.189489:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2348:x1875064614047872:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201148.189573:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2348:x1875064614047872:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 85us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201148.189581:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 241 00000100:00100000:3.0:1788201148.189940:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614048000 00000100:00100000:3.0:1788201148.189946:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614048000 00000100:00100000:3.0:1788201148.189998:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 86 00000100:00100000:3.0:1788201148.190007:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2348:x1875064614048000:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201148.190043:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2348:x1875064614048000:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 39us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201148.190050:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 86 00000100:00080000:0.0:1788201148.190118:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788201148.881521:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201149.196358:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201149.196384:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622465408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201149.196461:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201149.196577:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622465408 00000100:00100000:2.0:1788201149.196584:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622465408 00000100:00100000:2.0:1788201149.196641:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788201149.196651:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622465408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201149.196685:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201149.196744:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622465408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201149.196751:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788201149.196791:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b00408e2d80 x1875064622465408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201149.196810:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622465408:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201149.197908:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201149.199192:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622465664:0@lo:400:kworker.0 00000100:00100000:1.0:1788201149.199258:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201149.199300:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201149.199305:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622465536:0@lo:400:kworker.0 00000100:00100000:1.0:1788201149.199331:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201149.199369:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622465664 00000100:00100000:1.0:1788201149.199387:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622465664 00000100:00100000:1.0:1788201149.199429:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788201149.199438:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622465664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201149.199489:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622465664:12345-0@lo:400:kworker.0 Request processed in 52us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201149.199497:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788201149.199532:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622465664:0@lo:400:kworker.0 00000100:00100000:3.0:1788201149.200051:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622465920:0@lo:400:kworker.0 00000100:00100000:3.0:1788201149.200102:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201149.200124:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201149.200130:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622465792:0@lo:400:kworker.0 00000100:00100000:3.0:1788201149.200176:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201149.200205:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622465920 00000100:00100000:3.0:1788201149.200210:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622465920 00000100:00100000:3.0:1788201149.200249:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201149.200256:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622465920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201149.200292:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622465920:12345-0@lo:400:kworker.0 Request processed in 37us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201149.200298:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201149.200317:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622465792 00000100:00100000:3.0:1788201149.200320:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622465792 00000100:00100000:3.0:1788201149.200343:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788201149.200349:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622465792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201149.200377:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622465792:12345-0@lo:400:kworker.0 Request processed in 29us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201149.200383:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788201149.200411:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622465792:0@lo:400:kworker.0 00010000:00080000:3.0:1788201149.200423:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0035f25f80 x1875064622465920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201149.200434:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622465920:0@lo:400:kworker.0 00000100:00080000:3.0:1788201149.200467:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201149.200472:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201149.201566:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622465536 00000100:00100000:2.0:1788201149.201574:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622465536 00000100:00100000:2.0:1788201149.201619:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788201149.201628:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622465536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201149.201688:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622465536:12345-0@lo:400:kworker.0 Request processed in 62us (2356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201149.201702:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788201149.201761:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622465536:0@lo:400:kworker.0 00000100:00100000:0.0:1788201149.202221:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201149.202234:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622466048:0@lo:400:kworker.0 00000100:00100000:0.0:1788201149.202272:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201149.202372:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622466048 00000100:00100000:1.0:1788201149.202377:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622466048 00000100:00100000:1.0:1788201149.202429:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788201149.202437:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622466048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201149.202488:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622466048:12345-0@lo:400:kworker.0 Request processed in 52us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201149.202495:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788201149.202611:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201149.202828:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622466048:0@lo:400:kworker.0 00010000:00010000:1.0:1788201149.899278:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201150.223071:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622466176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201150.223225:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788201150.223281:0:7209:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 229348145959ns, next at 230348143052ns, rc = 0 00000100:00100000:3.0:1788201150.223740:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622466176 00000100:00100000:3.0:1788201150.223752:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622466176 00000100:00100000:2.0:1788201150.224021:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201150.224036:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622466176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201150.224243:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201150.224369:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622466176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 337us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201150.224377:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788201150.225034:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b003f398000 x1875064622466176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201150.225063:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622466176:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788201150.923446:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201151.947619:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788201152.876403:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00080000:0.0:1788201152.876421:0:5849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788201152.876435:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1788201152.876451:0:5849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788201152.877330:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622466304:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201152.877518:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201152.877562:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622466304 00000100:00100000:3.0:1788201152.877570:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622466304 00000100:00080000:2.0:1788201152.877599:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201152.877635:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201152.877645:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622466304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201152.877672:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788201152.877705:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a95c8bb, atime: 0x6a95c8bb, ctime: 0x6a95c8bb, blocks: 0x1 00010000:00010000:3.0:1788201152.877714:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005045d51c/0x72011f792b786d17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201152.877729:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=232s v=(0 0) 00010000:00010000:3.0:1788201152.877734:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201152.877739:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005045d51c/0x72011f792b786d17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201152.877755:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005045d51c/0x72011f792b786d17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201152.877764:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005045d51c/0x72011f792b786d17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201152.877771:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005045d51c/0x72011f792b786d17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201152.877791:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201152.878332:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3294:x1875064622466304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 688us (813us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788201152.878340:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788201152.878979:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201152.878988:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005045d51c/0x72011f792b786d17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201152.879000:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fc200 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201152.879004:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005045d51c/0x72011f792b786d17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201152.879014:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005045d51c/0x72011f792b786d17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201152.879034:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005045d51c/0x72011f792b786d17 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201152.879042:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005045d51c/0x72011f792b786d17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201152.879070:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201152.879072:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201152.879080:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788201152.879338:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b000673c380/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788201152.879345:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622466304:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201152.972322:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201153.006969:0:11616:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1788201153.305537:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201153.305577:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201153.305622:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201153.305653:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201153.305682:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614048256 00000100:00100000:0.0:1788201153.305692:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614048256 00000100:00100000:0.0:1788201153.305756:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614048512 00000100:00100000:0.0:1788201153.305761:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614048512 00000100:00100000:0.0:1788201153.305790:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 90 00000100:00100000:0.0:1788201153.305801:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2348:x1875064614048256:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201153.305896:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2348:x1875064614048256:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 97us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201153.305905:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 90 00000100:00100000:0.0:1788201153.305930:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 91 00000100:00100000:0.0:1788201153.305941:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2348:x1875064614048512:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201153.305972:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2348:x1875064614048512:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 35us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201153.305979:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 91 00000100:00100000:0.0:1788201153.306003:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614048128 00000100:00100000:0.0:1788201153.306007:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614048128 00000100:00100000:0.0:1788201153.306041:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 243 00000100:00100000:0.0:1788201153.306048:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2348:x1875064614048128:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201153.306085:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2348:x1875064614048128:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 37us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201153.306110:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 243 00000100:00100000:0.0:1788201153.306177:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614048384 00000100:00100000:0.0:1788201153.306183:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614048384 00000100:00100000:0.0:1788201153.306226:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:0.0:1788201153.306234:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2348:x1875064614048384:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201153.306264:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2348:x1875064614048384:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 31us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201153.306273:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00080000:0.0:1788201153.306299:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201153.306304:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1788201153.388353:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1788201153.998328:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201154.316406:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622466432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201154.316649:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201154.316767:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622466432 00000100:00100000:0.0:1788201154.316775:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622466432 00000100:00100000:0.0:1788201154.316831:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788201154.316841:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622466432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201154.316876:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201154.316918:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622466432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201154.316925:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788201154.316981:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788201154.317011:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b00408e0a80 x1875064622466432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201154.317029:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622466432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201154.320081:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622466560:0@lo:400:kworker.0 00000100:00100000:3.0:1788201154.320167:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201154.320203:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622467072:0@lo:400:kworker.0 00000100:00100000:3.0:1788201154.320228:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201154.320254:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201154.320260:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622466688:0@lo:400:kworker.0 00000100:00100000:3.0:1788201154.320283:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201154.320312:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622466816:0@lo:400:kworker.0 00000100:00100000:3.0:1788201154.320335:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201154.320352:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201154.320357:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622466944:0@lo:400:kworker.0 00000100:00100000:3.0:1788201154.320380:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201154.320491:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622466560 00000100:00100000:1.0:1788201154.320498:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622466560 00000100:00100000:1.0:1788201154.320539:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788201154.320548:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0009fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622466560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201154.320598:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0009fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622466560:12345-0@lo:400:kworker.0 Request processed in 52us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201154.320606:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788201154.321868:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622467072 00000100:00100000:3.0:1788201154.321878:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622467072 00000100:00100000:3.0:1788201154.321935:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622466688 00000100:00100000:3.0:1788201154.321939:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622466688 00000100:00100000:3.0:1788201154.321951:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622466816 00000100:00100000:3.0:1788201154.321953:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622466816 00000100:00100000:3.0:1788201154.321965:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788201154.321972:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622467072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201154.322033:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622467072:12345-0@lo:400:kworker.0 Request processed in 61us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201154.322038:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788201154.322062:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788201154.322068:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622466688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201154.322092:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622466688:12345-0@lo:400:kworker.0 Request processed in 24us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201154.322110:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788201154.322121:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788201154.322126:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622466816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201154.322174:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622466816:12345-0@lo:400:kworker.0 Request processed in 48us (1838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201154.322179:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788201154.322198:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622466944 00000100:00100000:3.0:1788201154.322201:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622466944 00000100:00100000:3.0:1788201154.322223:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201154.322228:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622466944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201154.322255:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622466944:12345-0@lo:400:kworker.0 Request processed in 27us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201154.322260:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201154.322296:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622466688:0@lo:400:kworker.0 00000100:00100000:3.0:1788201154.322308:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622466560:0@lo:400:kworker.0 00000100:00100000:3.0:1788201154.322317:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622467072:0@lo:400:kworker.0 00000100:00100000:3.0:1788201154.322351:0:3294:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788201154.322357:0:3294:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b000673c380, transno 4294967300 00000100:00100000:3.0:1788201154.322366:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622466944:0@lo:400:kworker.0 00000100:00100000:3.0:1788201154.322377:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622466816:0@lo:400:kworker.0 00000100:00080000:1.0:1788201154.322837:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201154.322842:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1788201154.336126:0:11666:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6f312bf0 20000000:00000080:3.0:1788201154.336403:0:11666:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b003b2c4800 uarg=0000000000000000 20000000:01000000:3.0:1788201154.336500:0:11666:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788201154.336512:0:11666:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788201154.336517:0:11666:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788201154.337096:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788201154.337398:0:11666:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788201154.348529:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788201154.348589:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788201154.348647:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788201154.348665:0:11666:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788201154.348686:0:11666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b00126fde00/0x72011f792b786d1e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.348706:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b000676fc00/0x72011f792b786bb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ce4 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.348714:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b000676e200/0x72011f792b786bc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ceb expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.348722:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0001681600/0x72011f792b786bce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786bc7 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.348728:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b001f8f1a00/0x72011f792b786bdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786bd5 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.348734:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b00126fdc00/0x72011f792b786bea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786be3 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.348740:0:11666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b00126fde00/0x72011f792b786d1e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.348778:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b00126fdc00/0x72011f792b786bea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b786be3 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.348790:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b00126fdc00/0x72011f792b786bea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b786be3 expref: 18 pid: 5819 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201154.348814:0:11666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875064622467200:0@lo:104: 00000100:00100000:3.0:1788201154.348877:0:11666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201154.348932:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b001f8f1a00/0x72011f792b786bdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b786bd5 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.348941:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b001f8f1a00/0x72011f792b786bdc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b786bd5 expref: 18 pid: 5821 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201154.348949:0:11666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875064622467328:0@lo:104: 00000100:00100000:3.0:1788201154.348971:0:11666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201154.349008:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0001681600/0x72011f792b786bce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b786bc7 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.349016:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b0001681600/0x72011f792b786bce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b786bc7 expref: 18 pid: 5821 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201154.349024:0:11666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875064622467456:0@lo:104: 00000100:00100000:3.0:1788201154.349059:0:11666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201154.349077:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b000676e200/0x72011f792b786bc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ceb expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.349087:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b000676e200/0x72011f792b786bc0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ceb expref: 12 pid: 5821 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201154.349097:0:11666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875064622467584:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201154.350618:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201154.350648:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622467200 00000100:00100000:1.0:1788201154.350655:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622467200 00000100:00100000:1.0:1788201154.350692:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622467328 00000100:00100000:1.0:1788201154.350696:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622467328 00000100:00100000:1.0:1788201154.350707:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622467456 00000100:00100000:1.0:1788201154.350710:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622467456 00000100:00100000:1.0:1788201154.350725:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201154.350734:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16f590af-689d-4459-b486-809c9db65822+5:11666:x1875064622467200:12345-0@lo:104: 00010000:00010000:1.0:1788201154.350750:0:5811:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1000/0x72011f792b786be3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786bea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.350827:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201154.350834:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16f590af-689d-4459-b486-809c9db65822+5:11666:x1875064622467200:12345-0@lo:104: Request processed in 101us (1956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201154.350841:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201154.350857:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201154.350863:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16f590af-689d-4459-b486-809c9db65822+4:11666:x1875064622467328:12345-0@lo:104: 00010000:00010000:1.0:1788201154.350871:0:5811:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b0001681a00/0x72011f792b786bd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786bdc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.350903:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788201154.350908:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16f590af-689d-4459-b486-809c9db65822+4:11666:x1875064622467328:12345-0@lo:104: Request processed in 46us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201154.350914:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201154.350927:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201154.350933:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f934450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16f590af-689d-4459-b486-809c9db65822+3:11666:x1875064622467456:12345-0@lo:104: 00010000:00010000:1.0:1788201154.350939:0:5811:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b0001680000/0x72011f792b786bc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786bce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.350983:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788201154.350988:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f934450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16f590af-689d-4459-b486-809c9db65822+3:11666:x1875064622467456:12345-0@lo:104: Request processed in 56us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201154.350994:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788201154.351129:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201154.351287:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1000/0x72011f792b786be3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786bea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.351295:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1788201154.351299:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1000/0x72011f792b786be3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b786bea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.351314:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1000/0x72011f792b786be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b786bea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201154.351322:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1000/0x72011f792b786be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b786bea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201154.351327:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201154.351369:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1000/0x72011f792b786be3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786bea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.351376:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201154.351397:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1000/0x72011f792b786be3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786bea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.351404:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1000/0x72011f792b786be3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786bea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201154.351598:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622467712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201154.351632:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201154.351717:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622467712 00000100:00100000:2.0:1788201154.351723:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622467712 00010000:00010000:2.0:1788201154.351747:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b00126fdc00/0x72011f792b786bea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786be3 expref: 19 pid: 5819 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201154.351778:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201154.351785:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622467712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201154.351796:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201154.351801:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b00126fdc00/0x72011f792b786bea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786be3 expref: 19 pid: 5819 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.351813:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b00126fdc00/0x72011f792b786bea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b786be3 expref: 19 pid: 5819 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.351830:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201154.351864:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622467712:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.351870:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201154.351902:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622467712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201154.352017:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201154.352022:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0001681a00/0x72011f792b786bd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786bdc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.352027:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681a00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1788201154.352030:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0001681a00/0x72011f792b786bd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b786bdc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.352036:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0001681a00/0x72011f792b786bd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b786bdc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201154.352042:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0001681a00/0x72011f792b786bd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b786bdc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201154.352073:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201154.352100:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b0001681a00/0x72011f792b786bd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786bdc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.352106:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788201154.352287:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622467840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201154.352315:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201154.352493:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622467840 00000100:00100000:2.0:1788201154.352497:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622467840 00010000:00010000:2.0:1788201154.352514:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b001f8f1a00/0x72011f792b786bdc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786bd5 expref: 19 pid: 5821 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201154.352540:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788201154.352546:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622467840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201154.352555:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201154.352559:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b001f8f1a00/0x72011f792b786bdc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786bd5 expref: 19 pid: 5821 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.352575:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b001f8f1a00/0x72011f792b786bdc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b786bd5 expref: 19 pid: 5821 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.352586:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201154.352615:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622467840:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.352622:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788201154.352648:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622467840:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201154.352838:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b000676fc00/0x72011f792b786bb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ce4 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.352861:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b000676fc00/0x72011f792b786bb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ce4 expref: 12 pid: 5821 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201154.352872:0:11666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875064622467968:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201154.352913:0:11666:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005d300c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788201154.352928:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00126fdc00/0x72011f792b786bea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b786be3 expref: 18 pid: 5819 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201154.352939:0:11666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875064622467200:0@lo:104: 00010000:00010000:3.0:1788201154.352948:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b001f8f1a00/0x72011f792b786bdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b786bd5 expref: 17 pid: 5821 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201154.352955:0:11666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875064622467328:0@lo:104: 00000100:00100000:3.0:1788201154.352963:0:11666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875064622467456:0@lo:104: 00010000:00010000:3.0:1788201154.353547:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201154.353555:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0001680000/0x72011f792b786bc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b786bce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.353564:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1788201154.353567:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0001680000/0x72011f792b786bc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b786bce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.353575:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0001680000/0x72011f792b786bc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b786bce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201154.353582:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0001680000/0x72011f792b786bc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b786bce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201154.353599:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201154.353625:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b0001680000/0x72011f792b786bc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786bce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.353631:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201154.353643:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0001680000/0x72011f792b786bc7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786bce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.353649:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0001680000/0x72011f792b786bc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786bce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.353659:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201154.353661:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201154.353663:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201154.353669:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201154.353695:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622468096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201154.353727:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201154.353806:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622468096 00000100:00100000:2.0:1788201154.353811:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622468096 00010000:00010000:2.0:1788201154.353829:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0001681600/0x72011f792b786bce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786bc7 expref: 17 pid: 5821 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201154.353859:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201154.353866:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000679b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+17:3295:x1875064622468096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201154.353875:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201154.353880:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0001681600/0x72011f792b786bce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b786bc7 expref: 17 pid: 5821 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.353890:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0001681600/0x72011f792b786bce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b786bc7 expref: 17 pid: 5821 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.353901:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0001681600/0x72011f792b786bce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b786bc7 expref: 17 pid: 5821 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.353913:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201154.353949:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000679b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+16:3295:x1875064622468096:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.353965:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201154.354017:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622468096:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201154.356892:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0001681a00/0x72011f792b786bd5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786bdc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.356910:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0001681a00/0x72011f792b786bd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b786bdc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.356928:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201154.356931:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201154.356934:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201154.358822:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201154.358856:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201154.358922:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614048768 00000100:00100000:1.0:1788201154.358930:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614048768 00010000:00010000:1.0:1788201154.358965:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b000676fc00/0x72011f792b786bb9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ce4 expref: 13 pid: 5821 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201154.359003:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614048640 00000100:00100000:1.0:1788201154.359006:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614048640 00010000:00010000:1.0:1788201154.359020:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b000676e200/0x72011f792b786bc0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ceb expref: 14 pid: 5821 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201154.359041:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:1.0:1788201154.359068:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79fcbf4-8d24-427b-827f-6b1cb026b088+14:2348:x1875064614048768:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201154.359083:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201154.359089:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b000676fc00/0x72011f792b786bb9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ce4 expref: 14 pid: 5821 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.359101:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b000676fc00/0x72011f792b786bb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ce4 expref: 14 pid: 5821 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.359180:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201154.359231:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79fcbf4-8d24-427b-827f-6b1cb026b088+14:2348:x1875064614048768:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 163us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201154.359239:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:1.0:1788201154.359494:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:1.0:1788201154.359505:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2348:x1875064614048640:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201154.359514:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201154.359519:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b000676e200/0x72011f792b786bc0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ceb expref: 13 pid: 5821 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.359529:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b000676e200/0x72011f792b786bc0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ceb expref: 13 pid: 5821 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.359542:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b00126fde00/0x72011f792b786d1e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.359550:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00126fde00/0x72011f792b786d1e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.359567:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b00126fde00/0x72011f792b786d1e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.359575:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b00126fde00/0x72011f792b786d1e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.359583:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b00126fde00/0x72011f792b786d1e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.359591:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b00126fde00/0x72011f792b786d1e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.359603:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fde00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201154.359608:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b00126fde00/0x72011f792b786d1e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.359616:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b00126fde00/0x72011f792b786d1e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.359625:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b00126fde00/0x72011f792b786d1e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.359634:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201154.359656:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2348:x1875064614048640:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 154us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201154.359662:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 34 00010000:00010000:3.0:1788201154.359846:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b000676e200/0x72011f792b786bc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ceb expref: 12 pid: 5821 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201154.359859:0:11666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875064622467584:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788201154.359870:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b000676fc00/0x72011f792b786bb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ce4 expref: 11 pid: 5821 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201154.359879:0:11666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875064622467968:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788201154.359910:0:11666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b00126fde00/0x72011f792b786d1e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.359929:0:11666:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b00126fde00/0x72011f792b786d1e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.359936:0:11666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b00126fde00/0x72011f792b786d1e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.359943:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00126fde00/0x72011f792b786d1e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201155.019828:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201155.339628:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f39aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622468224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201155.339700:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201155.339817:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622468224 00000100:00100000:0.0:1788201155.339824:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622468224 00000100:00100000:0.0:1788201155.339874:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788201155.339884:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622468224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201155.339921:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201155.347021:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622468224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7127us (7308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201155.347048:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201155.348519:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f39aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622468224:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1788201155.980071:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788201155.980080:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b003f8e9800 from 7 10000000:01000000:2.0:1788201155.980084:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201155.980128:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1c00/0x72011f792b786d25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201155.980171:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1c00/0x72011f792b786d25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201155.980182:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1c00/0x72011f792b786d25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201155.980208:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622468352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201155.980273:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201155.980338:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8df900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201155.980354:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622468352 00000100:00100000:1.0:1788201155.980363:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622468352 00000100:00100000:1.0:1788201155.980423:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788201155.980433:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0009fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+16:5825:x1875064622468352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201155.980448:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201155.980462:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0001681000/0x72011f792b786d2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786d25 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201155.980483:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0001681000/0x72011f792b786d2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786d25 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201155.980492:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0001681000/0x72011f792b786d2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786d25 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201155.980501:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681000, rc 0) 00000100:00100000:1.0:1788201155.980567:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0009fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622468352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201155.980574:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788201155.980638:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622468352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201155.980652:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1c00/0x72011f792b786d25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786d2c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201155.980661:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1c00/0x72011f792b786d25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786d2c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201155.980721:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622468480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201155.980744:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201155.980769:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8df900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201155.980800:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622468480 00000100:00100000:0.0:1788201155.980805:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622468480 00000100:00100000:0.0:1788201155.980854:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788201155.980869:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0009fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622468480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201155.981107:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0009fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622468480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201155.981114:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788201155.981176:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622468480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201155.981203:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622468608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201155.981240:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201155.981273:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8df900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201155.981360:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622468608 00000100:00100000:1.0:1788201155.981364:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622468608 00000100:00100000:1.0:1788201155.981399:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788201155.981406:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00109dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622468608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201155.981563:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00109dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622468608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201155.981569:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788201155.981774:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622468608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201155.982319:0:11679:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:11679:1875064622468736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201155.982361:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201155.982396:0:11679:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8df240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201155.982452:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622468736 00000100:00100000:0.0:1788201155.982525:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622468736 00000100:00100000:0.0:1788201155.982564:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788201155.982572:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00109de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+17:11679:x1875064622468736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201155.982924:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00109de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+17:11679:x1875064622468736:12345-0@lo:502:llog_process_th.0 Request processed in 352us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201155.982932:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788201155.985525:0:11679:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:11679:1875064622468736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201155.985575:0:11679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201155.985588:0:11679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201155.985590:0:11679:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788201155.985599:0:11679:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b003f8e9800 00000020:00000080:2.0:1788201155.985602:0:11679:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788201155.985874:0:11679:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:11679:1875064622468864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201155.985944:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201155.986002:0:11679:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8df240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201155.986094:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622468864 00000100:00100000:1.0:1788201155.986100:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622468864 00000100:00100000:1.0:1788201155.986181:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788201155.986191:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+17:11679:x1875064622468864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201155.986427:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+17:11679:x1875064622468864:12345-0@lo:502:llog_process_th.0 Request processed in 237us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201155.986436:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788201155.986659:0:11679:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:11679:1875064622468864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201155.986682:0:11679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201155.986688:0:11679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201155.986690:0:11679:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788201155.986695:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788201155.987017:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788201155.987047:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201155.987057:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1c00/0x72011f792b786d25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786d2c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201155.987068:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1c00/0x72011f792b786d25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786d2c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201155.987078:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788201155.987080:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b0010346000 from 7 10000000:01000000:1.0:1788201155.987083:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201155.987118:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681400/0x72011f792b786d33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201155.987126:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0001681400/0x72011f792b786d33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201155.987220:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0001681400/0x72011f792b786d33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201155.987239:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f399880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622468992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201155.987278:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201155.987310:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005124900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201155.987374:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622468992 00000100:00100000:2.0:1788201155.987380:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622468992 00000100:00100000:2.0:1788201155.987415:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788201155.987422:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+17:5825:x1875064622468992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201155.987433:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201155.987444:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b001f8f0a00/0x72011f792b786d3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786d33 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201155.987475:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b001f8f0a00/0x72011f792b786d3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786d33 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201155.987492:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b001f8f0a00/0x72011f792b786d3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786d33 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201155.987500:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0a00, rc 0) 00000100:00100000:2.0:1788201155.987535:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622468992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201155.987542:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788201155.987574:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f399880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622468992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201155.987585:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0001681400/0x72011f792b786d33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786d3a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201155.987594:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0001681400/0x72011f792b786d33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786d3a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201155.987637:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622469120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201155.987663:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201155.987676:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8df240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201155.987687:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622469120 00000100:00100000:2.0:1788201155.987690:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622469120 00000100:00100000:2.0:1788201155.987721:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788201155.987727:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622469120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201155.988304:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622469120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 574us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201155.988311:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788201155.988688:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622469120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201155.988736:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f39a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622469248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201155.988790:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201155.988821:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00051246c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201155.988863:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622469248 00000100:00100000:3.0:1788201155.988868:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622469248 00000100:00100000:3.0:1788201155.988908:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788201155.988916:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622469248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201155.989080:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622469248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201155.989087:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788201155.989123:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f39a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622469248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201155.989330:0:11680:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:11680:1875064622469376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201155.989363:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201155.989385:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622469376 00000100:00100000:3.0:1788201155.989389:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622469376 00000100:00100000:3.0:1788201155.989427:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788201155.989434:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:11680:x1875064622469376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201155.990767:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:11680:x1875064622469376:12345-0@lo:502:llog_process_th.0 Request processed in 1327us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201155.990777:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788201155.990840:0:11680:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005d30780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201155.990860:0:11680:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:11680:1875064622469376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201155.990889:0:11680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201155.990897:0:11680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201155.990900:0:11680:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788201155.990905:0:11680:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b0010346000 00000020:00000080:3.0:1788201155.990908:0:11680:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788201155.993888:0:11680:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:11680:1875064622469504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201155.994566:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201155.994675:0:11680:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005d30780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201155.999616:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622469504 00000100:00100000:2.0:1788201155.999633:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622469504 00000100:00100000:2.0:1788201155.999716:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788201155.999727:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:11680:x1875064622469504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201156.000004:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+18:11680:x1875064622469504:12345-0@lo:502:llog_process_th.0 Request processed in 278us (5438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201156.000012:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788201156.000278:0:11680:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:11680:1875064622469504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201156.000310:0:11680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201156.000318:0:11680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201156.000320:0:11680:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788201156.000324:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788201156.001616:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788201156.001645:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201156.001656:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681400/0x72011f792b786d33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786d3a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.001667:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0001681400/0x72011f792b786d33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786d3a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201156.001678:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788201156.001681:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b0007c1d000 from 7 10000000:01000000:2.0:1788201156.001683:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201156.001731:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0400/0x72011f792b786d41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.001749:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0400/0x72011f792b786d41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.001759:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0400/0x72011f792b786d41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201156.001783:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622469632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201156.001840:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201156.001891:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8df000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201156.002075:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622469632 00000100:00100000:3.0:1788201156.002082:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622469632 00000100:00100000:3.0:1788201156.002162:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788201156.002172:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00067ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+18:5825:x1875064622469632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201156.002186:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201156.002198:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b00126fde00/0x72011f792b786d48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b786d41 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.002221:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b00126fde00/0x72011f792b786d48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b786d41 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.002231:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b00126fde00/0x72011f792b786d48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b786d41 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.002240:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fde00, rc 0) 00000100:00100000:3.0:1788201156.002279:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00067ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622469632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.002285:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788201156.002481:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622469632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201156.002502:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0400/0x72011f792b786d41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786d48 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.002511:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0400/0x72011f792b786d41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786d48 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201156.002560:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622469760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201156.005414:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201156.005499:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8df000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201156.011115:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622469760 00000100:00100000:3.0:1788201156.011128:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622469760 00000100:00100000:3.0:1788201156.011213:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788201156.011223:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000506a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622469760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.011509:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000506a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622469760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (6100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.011516:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788201156.011641:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622469760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201156.011688:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622469888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201156.011743:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201156.011778:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8df000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201156.012042:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622469888 00000100:00100000:3.0:1788201156.012047:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622469888 00000100:00100000:3.0:1788201156.012081:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788201156.012088:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000506b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622469888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.012294:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000506b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:5825:x1875064622469888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.012307:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788201156.012521:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16f590af-689d-4459-b486-809c9db65822:5825:1875064622469888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201156.014503:0:11683:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:11683:1875064622470016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201156.014568:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201156.014605:0:11683:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8df600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201156.014684:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622470016 00000100:00100000:3.0:1788201156.014691:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622470016 00000100:00100000:3.0:1788201156.014744:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788201156.014754:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000506a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:11683:x1875064622470016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201156.014963:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000506a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:11683:x1875064622470016:12345-0@lo:502:llog_process_th.0 Request processed in 210us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.014971:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788201156.015225:0:11683:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:11683:1875064622470016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201156.015251:0:11683:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201156.015259:0:11683:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201156.015261:0:11683:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788201156.015268:0:11683:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b0007c1d000 00000020:00000080:2.0:1788201156.015270:0:11683:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788201156.015355:0:11683:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:11683:1875064622470144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201156.015392:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201156.015415:0:11683:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8df600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201156.018845:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622470144 00000100:00100000:3.0:1788201156.018856:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622470144 00000100:00100000:3.0:1788201156.018913:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788201156.018923:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005069850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:11683:x1875064622470144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201156.019201:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005069850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:11683:x1875064622470144:12345-0@lo:502:llog_process_th.0 Request processed in 278us (3807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.019209:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788201156.019597:0:11683:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16f590af-689d-4459-b486-809c9db65822:11683:1875064622470144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201156.019631:0:11683:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201156.019638:0:11683:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201156.019641:0:11683:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788201156.019646:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788201156.021172:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788201156.021197:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201156.021209:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0400/0x72011f792b786d41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786d48 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.021221:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0400/0x72011f792b786d41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786d48 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201156.036114:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788201156.049758:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201156.254026:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201156.261550:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614048896 00000100:00100000:0.0:1788201156.261563:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614048896 00000100:00100000:0.0:1788201156.261643:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 260 00000100:00100000:0.0:1788201156.261653:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+11:5588:x1875064614048896:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201156.261671:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201156.261691:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b000676ea00/0x72011f792b786d4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d38 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.261733:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b000676ea00/0x72011f792b786d4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d38 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.261755:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b000676ea00/0x72011f792b786d4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d38 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.261764:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676ea00, rc 0) 00000100:00100000:0.0:1788201156.261838:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:5588:x1875064614048896:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 Request processed in 187us (7822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.261846:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 260 00000100:00100000:0.0:1788201156.269178:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201156.269917:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614049024 00000100:00100000:3.0:1788201156.269929:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614049024 00000100:00100000:3.0:1788201156.269999:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 261 00000100:00100000:3.0:1788201156.270025:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:5588:x1875064614049024:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.271605:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:5588:x1875064614049024:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 Request processed in 1574us (2462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.271617:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 261 00000100:00100000:1.0:1788201156.275537:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201156.275682:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614049152 00000100:00100000:3.0:1788201156.275701:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614049152 00000100:00100000:3.0:1788201156.275794:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 262 00000100:00100000:3.0:1788201156.275806:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:5588:x1875064614049152:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.276128:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:5588:x1875064614049152:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 Request processed in 323us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.276183:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 262 00000100:00100000:3.0:1788201156.292425:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201156.293249:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614049280 00000100:00100000:0.0:1788201156.293263:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614049280 00000100:00100000:0.0:1788201156.293347:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 263 00000100:00100000:0.0:1788201156.293359:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:9940:x1875064614049280:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788201156.294222:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:9940:x1875064614049280:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 860us (1808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.294234:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 263 00000100:00100000:1.0:1788201156.312110:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201156.315662:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614049408 00000100:00100000:3.0:1788201156.315682:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614049408 00000100:00100000:3.0:1788201156.315789:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 264 00000100:00100000:3.0:1788201156.315802:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:9940:x1875064614049408:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788201156.316552:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:9940:x1875064614049408:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 748us (4455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.316564:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 264 00000100:00100000:2.0:1788201156.332292:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201156.332506:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614049536 00000100:00100000:0.0:1788201156.332518:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614049536 00000100:00100000:0.0:1788201156.332579:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 265 00000100:00100000:0.0:1788201156.332591:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:5588:x1875064614049536:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201156.332615:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201156.332638:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b000676e800/0x72011f792b786d56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d3f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.332678:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b000676e800/0x72011f792b786d56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d3f expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.332692:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b000676e800/0x72011f792b786d56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d3f expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.332704:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676e800, rc 0) 00000100:00100000:0.0:1788201156.332781:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:5588:x1875064614049536:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 Request processed in 190us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.332809:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 265 00000100:00100000:0.0:1788201156.345976:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201156.348630:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614049664 00000100:00100000:2.0:1788201156.348651:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614049664 00000100:00100000:2.0:1788201156.348761:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 266 00000100:00100000:2.0:1788201156.348774:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:5588:x1875064614049664:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201156.351554:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:5588:x1875064614049664:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 Request processed in 2767us (5577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201156.351571:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 266 00000100:00100000:1.0:1788201156.379256:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201156.379477:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614049792 00000100:00100000:0.0:1788201156.379491:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614049792 00000100:00100000:0.0:1788201156.379571:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 267 00000100:00100000:0.0:1788201156.379588:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:5588:x1875064614049792:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201156.381434:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:5588:x1875064614049792:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 Request processed in 1837us (2176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.381452:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 267 00000100:00100000:1.0:1788201156.397270:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201156.399857:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614049920 00000100:00100000:2.0:1788201156.399879:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614049920 00000100:00100000:2.0:1788201156.399991:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 268 00000100:00100000:2.0:1788201156.400003:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:9943:x1875064614049920:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201156.400456:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:9943:x1875064614049920:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 453us (3198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201156.401833:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 268 00000100:00100000:1.0:1788201156.412252:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201156.412345:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614050048 00000100:00100000:3.0:1788201156.412359:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614050048 00000100:00100000:3.0:1788201156.412430:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 269 00000100:00100000:3.0:1788201156.412442:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:9943:x1875064614050048:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788201156.412895:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:9943:x1875064614050048:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 452us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.412906:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 269 00010000:00010000:3.0:1788201157.067767:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788201157.069295:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788201158.096169:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201158.429007:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201158.429121:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201158.439839:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201158.439867:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201158.439962:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614050176 00000100:00100000:2.0:1788201158.439972:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614050176 00000100:00100000:3.0:1788201158.440114:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614050304 00000100:00100000:3.0:1788201158.440147:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614050304 00000100:00100000:3.0:1788201158.440190:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614050560 00000100:00100000:3.0:1788201158.440205:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614050560 00000100:00100000:3.0:1788201158.440234:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 95 00000100:00100000:3.0:1788201158.440244:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2350:x1875064614050304:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201158.440315:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2350:x1875064614050304:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 73us (11319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201158.440322:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 95 00000100:00100000:3.0:1788201158.440338:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 96 00000100:00100000:3.0:1788201158.440346:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2350:x1875064614050560:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201158.440388:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2350:x1875064614050560:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 43us (11267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201158.440394:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 96 00000100:00080000:3.0:1788201158.440437:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201158.443200:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614050432 00000100:00100000:1.0:1788201158.443215:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614050432 00000100:00100000:1.0:1788201158.443290:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:1.0:1788201158.443300:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f39aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2350:x1875064614050432:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201158.443388:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f39aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2350:x1875064614050432:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 83us (3513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201158.443396:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00080000:3.0:1788201158.444026:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201158.454460:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 270 00000100:00100000:2.0:1788201158.454484:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2350:x1875064614050176:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201158.454577:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2350:x1875064614050176:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 104us (14747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201158.454600:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 270 00010000:00010000:2.0:1788201159.115616:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201159.435822:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622470272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201159.435919:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201159.436159:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622470272 00000100:00100000:2.0:1788201159.436171:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622470272 00000100:00100000:2.0:1788201159.436261:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201159.436273:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622470272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201159.436322:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201159.436395:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622470272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201159.436404:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788201159.436673:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788201159.436707:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b00408e1c00 x1875064622470272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201175 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201159.436731:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622470272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201159.436968:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622470656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201159.437019:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201159.437051:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201159.437057:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622470784:0@lo:400:kworker.0 00000100:00100000:1.0:1788201159.437084:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201159.437162:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622470528:0@lo:400:kworker.0 00000100:00100000:3.0:1788201159.437208:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201159.437239:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788201159.437244:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622470400:0@lo:400:kworker.0 00000100:00100000:3.0:1788201159.437274:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201159.437297:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622470912:0@lo:400:kworker.0 00000100:00100000:3.0:1788201159.437320:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201159.437349:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622470784 00000100:00100000:3.0:1788201159.437354:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622470784 00000100:00100000:3.0:1788201159.437417:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788201159.437425:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622470784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201159.437487:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622470784:12345-0@lo:400:kworker.0 Request processed in 62us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201159.437494:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788201159.437514:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622470400 00000100:00100000:3.0:1788201159.437518:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622470400 00000100:00100000:3.0:1788201159.437546:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788201159.437553:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3295:x1875064622470400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201159.437586:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3295:x1875064622470400:12345-0@lo:400:kworker.0 Request processed in 33us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201159.437592:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788201159.437626:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622470656 00000100:00100000:3.0:1788201159.437630:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622470656 00000100:00100000:3.0:1788201159.437655:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622470528 00000100:00100000:3.0:1788201159.437658:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622470528 00000100:00100000:3.0:1788201159.437669:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622470912 00000100:00100000:3.0:1788201159.437672:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622470912 00000100:00100000:3.0:1788201159.437684:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788201159.437690:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622470656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201159.437720:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622470656:12345-0@lo:400:kworker.0 Request processed in 30us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201159.437726:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788201159.437737:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788201159.437743:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622470528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201159.437773:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622470528:12345-0@lo:400:kworker.0 Request processed in 30us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201159.437779:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788201159.437789:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201159.437802:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875064622470912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201159.437829:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875064622470912:12345-0@lo:400:kworker.0 Request processed in 28us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201159.437835:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788201159.437849:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201159.437852:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201159.437876:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622470784:0@lo:400:kworker.0 00000100:00100000:3.0:1788201159.437888:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622470656:0@lo:400:kworker.0 00000100:00100000:3.0:1788201159.437916:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622470400:0@lo:400:kworker.0 00000100:00100000:3.0:1788201159.437925:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622470912:0@lo:400:kworker.0 00000100:00100000:3.0:1788201159.437934:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622470528:0@lo:400:kworker.0 00010000:00010000:3.0:1788201160.139588:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201160.464788:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201160.464819:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622471040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201160.464906:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201160.467547:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622471040 00000100:00100000:1.0:1788201160.467565:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622471040 00000100:00100000:1.0:1788201160.467662:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788201160.467676:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622471040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201160.467730:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201160.468009:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622471040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 327us (3092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201160.468019:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788201160.469609:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622471040:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201161.163777:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201162.188372:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201163.216682:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201163.545285:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201163.545336:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201163.545553:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201163.545607:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201163.545647:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614050944 00000100:00100000:1.0:1788201163.545658:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614050944 00000100:00100000:1.0:1788201163.545762:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:1.0:1788201163.545775:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2348:x1875064614050944:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201163.545869:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2348:x1875064614050944:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 98us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201163.545878:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00080000:1.0:1788201163.545906:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201163.546508:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614050688 00000100:00100000:0.0:1788201163.546516:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614050688 00000100:00100000:0.0:1788201163.546575:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 272 00000100:00100000:0.0:1788201163.546585:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2348:x1875064614050688:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201163.546645:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2348:x1875064614050688:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 62us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201163.546652:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 272 00000100:00100000:3.0:1788201163.547510:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614050816 00000100:00100000:3.0:1788201163.547520:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614050816 00000100:00100000:3.0:1788201163.547591:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614051072 00000100:00100000:3.0:1788201163.547603:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614051072 00000100:00100000:3.0:1788201163.547636:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 100 00000100:00100000:3.0:1788201163.547646:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2348:x1875064614050816:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201163.547711:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2348:x1875064614050816:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 66us (2441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201163.547717:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 100 00000100:00100000:3.0:1788201163.547732:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 101 00000100:00100000:3.0:1788201163.547739:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2348:x1875064614051072:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201163.547788:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2348:x1875064614051072:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 50us (2451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201163.547795:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 101 00000100:00080000:1.0:1788201163.548378:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788201164.236459:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201164.555508:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201164.555542:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622471168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201164.555635:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201164.555929:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622471168 00000100:00100000:2.0:1788201164.555939:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622471168 00000100:00100000:2.0:1788201164.556036:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201164.556048:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622471168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201164.556097:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201164.556176:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622471168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201164.556195:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201164.556424:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622471552:0@lo:400:kworker.0 00000100:00100000:1.0:1788201164.556474:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201164.556501:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201164.556507:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622471424:0@lo:400:kworker.0 00000100:00100000:1.0:1788201164.556532:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201164.556566:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622471552 00000100:00100000:1.0:1788201164.556572:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622471552 00000100:00100000:1.0:1788201164.556609:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622471424 00000100:00100000:1.0:1788201164.556612:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622471424 00000100:00100000:1.0:1788201164.556635:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788201164.556642:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622471552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201164.556686:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622471552:12345-0@lo:400:kworker.0 Request processed in 45us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201164.556694:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788201164.556708:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788201164.556714:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622471424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201164.556742:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622471424:12345-0@lo:400:kworker.0 Request processed in 29us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201164.556749:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788201164.556808:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622471424:0@lo:400:kworker.0 00000100:00100000:1.0:1788201164.556820:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622471552:0@lo:400:kworker.0 00000100:00080000:0.0:1788201164.557154:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201164.557161:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201164.557176:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622471296:0@lo:400:kworker.0 00000100:00100000:0.0:1788201164.557222:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201164.557261:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622471808:0@lo:400:kworker.0 00000100:00100000:0.0:1788201164.557286:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788201164.557327:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b00408e1c00 x1875064622471168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201164.557348:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622471168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201164.557365:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201164.557370:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0006650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622471680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201164.557398:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201164.557432:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622471680 00000100:00100000:0.0:1788201164.557438:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622471680 00000100:00100000:2.0:1788201164.557533:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622471296 00000100:00100000:2.0:1788201164.557538:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622471296 00000100:00100000:2.0:1788201164.557579:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788201164.557587:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622471296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201164.557630:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622471296:12345-0@lo:400:kworker.0 Request processed in 44us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201164.557636:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788201164.557809:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622471808 00000100:00100000:3.0:1788201164.557814:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622471808 00000100:00100000:3.0:1788201164.557864:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788201164.557872:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622471808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201164.557915:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622471808:12345-0@lo:400:kworker.0 Request processed in 44us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201164.557922:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1788201164.558127:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201164.558247:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201164.558256:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622471680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201164.558300:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622471680:12345-0@lo:400:kworker.0 Request processed in 45us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201164.558307:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201164.558371:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622471296:0@lo:400:kworker.0 00000100:00100000:3.0:1788201164.558392:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622471808:0@lo:400:kworker.0 00000100:00100000:3.0:1788201164.558415:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0006650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622471680:0@lo:400:kworker.0 00000100:00080000:2.0:1788201164.558479:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201165.259314:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201165.582540:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622471936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201165.582608:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201165.584163:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622471936 00000100:00100000:2.0:1788201165.584177:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622471936 00000100:00100000:2.0:1788201165.584256:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201165.584268:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622471936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201165.584308:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201165.584539:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622471936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 273us (1929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201165.584547:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788201165.584635:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622471936:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201166.289611:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788201167.307890:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788201167.308086:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201168.332007:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201168.669869:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201168.669924:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201168.670025:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614051328 00000100:00100000:2.0:1788201168.670038:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614051328 00000100:00100000:2.0:1788201168.670169:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 105 00000100:00100000:2.0:1788201168.670183:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2349:x1875064614051328:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201168.670279:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2349:x1875064614051328:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 100us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201168.670288:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 105 00000100:00080000:0.0:1788201168.670384:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201168.670621:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614051200 00000100:00100000:3.0:1788201168.670681:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614051200 00000100:00100000:3.0:1788201168.670728:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 274 00000100:00100000:3.0:1788201168.670736:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2349:x1875064614051200:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201168.670781:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2349:x1875064614051200:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 45us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201168.670788:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 274 00000100:00100000:1.0:1788201168.678715:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201168.678779:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201168.678890:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614051456 00000100:00100000:2.0:1788201168.678903:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614051456 00000100:00100000:2.0:1788201168.679006:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:2.0:1788201168.679028:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2347:x1875064614051456:12345-192.168.203.14@tcp:9:kworker.0 00000020:00000080:2.0:1788201168.679072:0:7765:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786c92 00000100:00080000:2.0:1788201168.679083:0:7765:0:(import.c:65:import_set_state_nolock()) ffff9b003f466800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201168.679129:0:7765:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1788201168.679518:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+2:2347:x1875064614051456:12345-192.168.203.14@tcp:9:kworker.0 Request processed in 491us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201168.679527:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00080000:0.0:1788201168.679698:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201168.680179:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614051584 00000100:00100000:3.0:1788201168.680204:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614051584 00000100:00100000:3.0:1788201168.680272:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 106 00000100:00100000:3.0:1788201168.680282:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2348:x1875064614051584:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201168.680358:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2348:x1875064614051584:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 77us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201168.680366:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 106 00010000:00010000:3.0:1788201168.680389:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201168.680955:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788201169.355556:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201169.676354:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201169.676379:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622472064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201169.676444:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201169.676570:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622472064 00000100:00100000:3.0:1788201169.676577:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622472064 00000100:00100000:3.0:1788201169.676635:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788201169.676645:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622472064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201169.676689:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201169.676760:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622472064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201169.676767:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788201169.677246:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788201169.677277:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b00408e2680 x1875064622472064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201169.677297:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622472064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201169.679101:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622472192:0@lo:400:kworker.0 00000100:00100000:1.0:1788201169.679208:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201169.679246:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622472704:0@lo:400:kworker.0 00000100:00100000:1.0:1788201169.679272:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201169.679312:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201169.679319:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622472320:0@lo:400:kworker.0 00000100:00100000:1.0:1788201169.679343:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201169.679382:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622472576:0@lo:400:kworker.0 00000100:00100000:1.0:1788201169.679408:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201169.679425:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201169.679430:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622472448:0@lo:400:kworker.0 00000100:00100000:1.0:1788201169.679473:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201169.679503:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622472704 00000100:00100000:1.0:1788201169.679509:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622472704 00000100:00100000:1.0:1788201169.679557:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622472320 00000100:00100000:1.0:1788201169.679560:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622472320 00000100:00100000:1.0:1788201169.679571:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622472448 00000100:00100000:1.0:1788201169.679586:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622472448 00000100:00100000:1.0:1788201169.679604:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788201169.679612:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622472704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201169.679675:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622472704:12345-0@lo:400:kworker.0 Request processed in 63us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201169.679682:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788201169.679698:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788201169.679704:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622472320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201169.679732:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622472320:12345-0@lo:400:kworker.0 Request processed in 28us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201169.679738:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788201169.679750:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788201169.679756:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622472448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201169.679788:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622472448:12345-0@lo:400:kworker.0 Request processed in 32us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201169.679794:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788201169.679835:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622472448:0@lo:400:kworker.0 00000100:00100000:1.0:1788201169.679861:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622472320:0@lo:400:kworker.0 00000100:00100000:1.0:1788201169.679870:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622472704:0@lo:400:kworker.0 00000100:00100000:0.0:1788201169.680459:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622472576 00000100:00100000:0.0:1788201169.680465:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622472576 00000100:00100000:0.0:1788201169.680513:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201169.680521:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622472576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201169.680587:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622472576:12345-0@lo:400:kworker.0 Request processed in 67us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201169.680593:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788201169.680611:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201169.680616:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201169.680742:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622472576:0@lo:400:kworker.0 00000100:00100000:3.0:1788201169.680815:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622472192 00000100:00100000:3.0:1788201169.680820:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622472192 00000100:00100000:3.0:1788201169.680863:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788201169.680870:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622472192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201169.680918:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622472192:12345-0@lo:400:kworker.0 Request processed in 49us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201169.680924:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788201169.682334:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622472192:0@lo:400:kworker.0 00010000:00010000:2.0:1788201170.379387:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201170.699734:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201170.702127:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622472832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201170.702221:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201170.702700:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622472832 00000100:00100000:3.0:1788201170.702720:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622472832 00000100:00100000:3.0:1788201170.702780:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201170.702790:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622472832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201170.702827:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201170.702922:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622472832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201170.702939:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201170.703359:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622472832:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201171.405252:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201172.427286:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201173.451676:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201173.787795:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201173.787839:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201173.787883:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201173.787967:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614051712 00000100:00100000:3.0:1788201173.787977:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614051712 00000100:00100000:3.0:1788201173.788084:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 276 00000100:00100000:3.0:1788201173.788095:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2349:x1875064614051712:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201173.788189:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2349:x1875064614051712:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 95us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201173.788196:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 276 00000100:00100000:0.0:1788201173.789304:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614051840 00000100:00100000:0.0:1788201173.789312:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614051840 00000100:00100000:0.0:1788201173.789366:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614051968 00000100:00100000:0.0:1788201173.789370:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614051968 00000100:00100000:0.0:1788201173.789407:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 110 00000100:00100000:0.0:1788201173.789416:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2349:x1875064614051840:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201173.789468:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2349:x1875064614051840:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 53us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201173.789475:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 110 00000100:00100000:0.0:1788201173.789490:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 111 00000100:00100000:0.0:1788201173.789498:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2349:x1875064614051968:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201173.789536:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2349:x1875064614051968:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 39us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201173.789543:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 111 00000100:00080000:3.0:1788201173.789650:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1788201173.853418:0:6702:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa6eef1a-3f03-469a-ac4c-2a406b6709bc 00000020:00000080:0.0:1788201173.853428:0:6702:0:(genops.c:906:class_export_put()) final put ffff9b003f461000/aa6eef1a-3f03-469a-ac4c-2a406b6709bc 00000020:00000080:1.0:1788201173.855019:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b003f461000/aa6eef1a-3f03-469a-ac4c-2a406b6709bc for lustre-OST0000 00000020:00000080:1.0:1788201173.855092:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b003f466800 for lustre-OST0000 00010000:00010000:2.0:1788201174.477333:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201174.795760:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622472960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201174.795921:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201174.795997:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201174.796004:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622473088:0@lo:400:kworker.0 00000100:00100000:1.0:1788201174.796038:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.796340:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622473088 00000100:00100000:3.0:1788201174.796350:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622473088 00000100:00100000:3.0:1788201174.796423:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788201174.796435:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622473088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201174.796505:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622473088:12345-0@lo:400:kworker.0 Request processed in 72us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201174.796514:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788201174.796595:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622473088:0@lo:400:kworker.0 00000100:00100000:0.0:1788201174.797018:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622472960 00000100:00100000:0.0:1788201174.797025:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622472960 00000100:00100000:0.0:1788201174.797082:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201174.797091:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622472960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201174.797126:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201174.797194:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622472960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201174.797200:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788201174.797231:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b00408e3800 x1875064622472960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201174.797250:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622472960:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788201174.797562:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201174.799761:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622473216:0@lo:400:kworker.0 00000100:00100000:2.0:1788201174.799861:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201174.799924:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201174.799930:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622473344:0@lo:400:kworker.0 00000100:00100000:2.0:1788201174.799951:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.799978:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622473600:0@lo:400:kworker.0 00000100:00100000:2.0:1788201174.799989:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622473216 00000100:00100000:2.0:1788201174.799998:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622473216 00000100:00100000:3.0:1788201174.800027:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.800056:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201174.800062:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622473344 00000100:00100000:3.0:1788201174.800064:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622473472:0@lo:400:kworker.0 00000100:00100000:2.0:1788201174.800068:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622473344 00000100:00100000:2.0:1788201174.800095:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622473600 00000100:00100000:2.0:1788201174.800099:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622473600 00000100:00100000:2.0:1788201174.800123:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788201174.800173:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622473216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201174.800174:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201174.800216:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788201174.800228:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622473344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201174.800243:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622473216:12345-0@lo:400:kworker.0 Request processed in 78us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201174.800252:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788201174.800571:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622473344:12345-0@lo:400:kworker.0 Request processed in 347us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201174.800579:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788201174.800598:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788201174.800605:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875064622473600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201174.800645:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875064622473600:12345-0@lo:400:kworker.0 Request processed in 41us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201174.800651:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788201174.800743:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622473472 00000100:00100000:2.0:1788201174.800748:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622473472 00000100:00100000:2.0:1788201174.800787:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788201174.800851:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622473472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201174.800973:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622473472:12345-0@lo:400:kworker.0 Request processed in 124us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201174.800979:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788201174.801018:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622473344:0@lo:400:kworker.0 00000100:00100000:2.0:1788201174.801030:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622473216:0@lo:400:kworker.0 00000100:00080000:2.0:1788201174.801062:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201174.801067:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201174.802428:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622473600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201174.802491:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622473472:0@lo:400:kworker.0 00010000:00010000:0.0:1788201175.500123:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201175.820934:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622473728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201175.821006:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201175.821118:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622473728 00000100:00100000:0.0:1788201175.821149:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622473728 00000100:00100000:0.0:1788201175.821200:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201175.821210:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622473728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201175.821245:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201175.821549:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622473728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 339us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201175.821557:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201175.821775:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622473728:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201176.523346:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201177.547560:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788201177.548726:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788201178.135428:0:11848:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:32:56 (1788201176) 00010000:00010000:2.0:1788201178.572155:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201178.908048:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201178.908098:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201178.908187:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201178.908292:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614052224 00000100:00100000:2.0:1788201178.908303:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614052224 00000100:00100000:2.0:1788201178.908390:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614052352 00000100:00100000:2.0:1788201178.908393:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614052352 00000100:00080000:0.0:1788201178.908438:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201178.908482:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614052096 00000100:00100000:1.0:1788201178.908487:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614052096 00000100:00100000:1.0:1788201178.908523:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 278 00000100:00100000:1.0:1788201178.908532:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2350:x1875064614052096:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201178.908594:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2350:x1875064614052096:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 63us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201178.908601:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 278 00000100:00100000:3.0:1788201178.914197:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 115 00000100:00100000:3.0:1788201178.914216:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2350:x1875064614052224:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201178.914384:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2350:x1875064614052224:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 175us (6346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201178.914392:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 115 00000100:00100000:3.0:1788201178.914427:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 116 00000100:00100000:3.0:1788201178.914436:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2350:x1875064614052352:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201178.914463:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2350:x1875064614052352:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 29us (6276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201178.914469:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 116 00010000:00010000:1.0:1788201179.595674:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201179.815394:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201179.815475:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614052480 00000100:00100000:3.0:1788201179.815484:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614052480 00000100:00100000:3.0:1788201179.815609:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:3.0:1788201179.815620:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:10213:x1875064614052480:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201179.815642:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201179.815666:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786d5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d46 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.815737:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786d64 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.815749:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786d64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.815761:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786d64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201179.816210:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788201179.816216:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201179.816457:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786d64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.816484:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786d5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d46 expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.816513:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786d64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d46 expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.817534:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:3.0:1788201179.817541:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201179.817544:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fd400, rc 0) 00000100:00100000:3.0:1788201179.817610:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:10213:x1875064614052480:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 1990us (2224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201179.817619:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:1.0:1788201179.838924:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201179.839018:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614052608 00000100:00100000:3.0:1788201179.839032:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614052608 00000100:00100000:3.0:1788201179.839279:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:3.0:1788201179.839291:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:10214:x1875064614052608:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201179.839312:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201179.839332:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786d6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d4d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.839409:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786d72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.839434:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786d72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.839447:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786d72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.839463:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786d79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.839484:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786d79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.839503:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786d79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.839944:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fce00/0x72011f792b786d80 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.839955:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fce00/0x72011f792b786d80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.839962:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fce00/0x72011f792b786d80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201179.840059:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788201179.840064:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201179.842397:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fce00/0x72011f792b786d80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.842497:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786d72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.842507:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786d72 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.842514:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786d72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.842520:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fc200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201179.842524:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786d72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.842549:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786d72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.842564:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:3.0:1788201179.842567:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201179.842572:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786d72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.842577:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786d72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.842592:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786d79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.842609:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786d79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.842616:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786d79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.842621:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fcc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201179.842624:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786d79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.842638:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786d79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.842644:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b00109a1500) 00010000:00010000:3.0:1788201179.842646:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201179.842648:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786d79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.842659:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786d79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.842705:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786d6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d4d expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.842719:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fce00/0x72011f792b786d80 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d4d expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.842727:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b00109a1100) 00010000:00010000:3.0:1788201179.842730:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201179.842732:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fce00, rc 0) 00000100:00100000:3.0:1788201179.842825:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:10214:x1875064614052608:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 3535us (3915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201179.842834:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:1.0:1788201179.858247:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201179.859972:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614052864 00000100:00100000:2.0:1788201179.859989:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614052864 00000100:00100000:2.0:1788201179.860214:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:2.0:1788201179.860227:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:10214:x1875064614052864:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201179.860256:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201179.860283:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1000/0x72011f792b786d87 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d54 expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.860430:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786d8e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.860448:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786d8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.860461:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786d8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.870943:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b786d95 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.870966:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b786d95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.870978:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b786d95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.871551:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b786d9c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.871562:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b786d9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.871570:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b786d9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201179.871582:0:9471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788201179.871803:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786d8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.871812:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786d8e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.871828:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786d8e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.871833:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201179.871838:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786d8e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.871845:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786d8e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.871858:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b00109a1100) 00010000:00010000:2.0:1788201179.871861:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201179.871879:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786d8e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.871886:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786d8e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.871898:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b786d95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.871904:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b786d95 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.871910:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b786d95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.871915:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201179.871918:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b786d95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.871934:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b786d95 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.871943:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b0011cb3b00) 00010000:00010000:2.0:1788201179.871946:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201179.871948:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b786d95 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.871954:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b786d95 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.872376:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1000/0x72011f792b786d87 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d54 expref: 10 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.872392:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b786d9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d54 expref: 9 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.872399:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b0011cb3e00) 00010000:00010000:2.0:1788201179.872401:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201179.872403:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0600, rc 0) 00000100:00100000:2.0:1788201179.872470:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:10214:x1875064614052864:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 12246us (14238us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788201179.872480:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:0.0:1788201179.876962:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201179.878754:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614052992 00000100:00100000:2.0:1788201179.878769:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614052992 00000100:00100000:2.0:1788201179.878835:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:2.0:1788201179.878856:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:10214:x1875064614052992:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788201179.878989:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:10214:x1875064614052992:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 Request processed in 144us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201179.878997:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:2.0:1788201179.915452:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0003ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622473856:0@lo:400:kworker.0 00000100:00100000:1.0:1788201179.915496:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0003ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622474112:0@lo:400:kworker.0 00000100:00100000:2.0:1788201179.915547:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201179.915624:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0003ee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622474240:0@lo:400:kworker.0 00000100:00100000:0.0:1788201179.915727:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0003ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622473984:0@lo:400:kworker.0 00000100:00100000:2.0:1788201179.916677:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0003ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622474368:0@lo:400:kworker.0 00000100:00100000:2.0:1788201179.916726:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201179.916851:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622473856 00000100:00100000:2.0:1788201179.916858:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622473856 00000100:00100000:2.0:1788201179.916912:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788201179.916921:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622473856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201179.916973:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622473856:12345-0@lo:400:kworker.0 Request processed in 53us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201179.916979:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788201179.917024:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0003ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622473856:0@lo:400:kworker.0 00000100:00100000:2.0:1788201179.917050:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622474368 00000100:00100000:2.0:1788201179.917053:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622474368 00000100:00100000:2.0:1788201179.917090:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788201179.917097:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622474368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201179.917161:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622474368:12345-0@lo:400:kworker.0 Request processed in 65us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201179.917167:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788201179.917191:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0003ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622474368:0@lo:400:kworker.0 00000100:00080000:2.0:1788201179.917216:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201179.922102:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201179.922539:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622474240 00000100:00100000:2.0:1788201179.922561:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622474240 00000100:00100000:2.0:1788201179.922634:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201179.922646:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622474240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201179.922723:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622474240:12345-0@lo:400:kworker.0 Request processed in 80us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201179.922731:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788201179.923874:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201179.923942:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0003ee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622474240:0@lo:400:kworker.0 00000100:00100000:0.0:1788201179.928769:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201179.928848:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0003ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622474496:0@lo:400:kworker.0 00000100:00100000:0.0:1788201179.928900:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201179.928942:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201179.928949:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622474624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201179.928975:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201179.929109:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622474624 00000100:00100000:0.0:1788201179.929119:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622474624 00000100:00080000:3.0:1788201179.930861:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201179.930909:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622473984 00000100:00100000:3.0:1788201179.930921:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622473984 00000100:00100000:3.0:1788201179.931008:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788201179.931350:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788201179.931363:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622473984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201179.931363:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622474624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201179.931466:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201179.931482:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622473984:12345-0@lo:400:kworker.0 Request processed in 123us (2725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201179.931507:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622474624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (2532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201179.931510:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788201179.931518:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788201179.931572:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b00408e1c00 x1875064622474624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201179.931597:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622474624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201179.931613:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0003ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622473984:0@lo:400:kworker.0 00000100:00100000:2.0:1788201179.933953:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622474496 00000100:00100000:2.0:1788201179.933974:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622474496 00000100:00100000:2.0:1788201179.934058:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788201179.934071:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622474496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201179.934229:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622474496:12345-0@lo:400:kworker.0 Request processed in 160us (5327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201179.934237:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788201179.934629:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b0003ee6680 x1875064622474496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201179.934649:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0003ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622474496:0@lo:400:kworker.0 00000100:00100000:1.0:1788201179.934730:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201179.935073:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622474112 00000100:00100000:2.0:1788201179.935079:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622474112 00000100:00100000:2.0:1788201179.935159:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788201179.935169:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622474112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201179.935320:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622474112:12345-0@lo:400:kworker.0 Request processed in 152us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201179.935328:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1788201179.936108:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201179.936834:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0003ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622474112:0@lo:400:kworker.0 00010000:00010000:3.0:1788201180.619246:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788201180.620068:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788201180.939584:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622474752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201180.939657:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201180.939787:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622474752 00000100:00100000:2.0:1788201180.939796:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622474752 00000100:00100000:2.0:1788201180.939849:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788201180.939868:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622474752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201180.939903:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201180.939947:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622474752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201180.939963:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788201180.940048:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622474752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788201181.643984:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201181.901990:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201181.902586:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614053120 00000100:00100000:0.0:1788201181.902597:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614053120 00000100:00100000:0.0:1788201181.902732:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 36 00000100:00100000:0.0:1788201181.902743:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:10256:x1875064614053120:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788201181.902763:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201181.902784:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786daa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903344:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786db1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903359:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786db1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903373:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786db1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903405:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b786db8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903413:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b786db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903420:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b786db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903863:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786db1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903873:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786db1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903879:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786db1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903885:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676fe00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201181.903889:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786db1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903897:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786db1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903909:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:0.0:1788201181.903912:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201181.903917:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786db1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903922:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786db1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903941:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b786db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903947:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b786db8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903952:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b786db8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903957:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676ec00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201181.903960:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b786db8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903966:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b786db8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903974:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b0002a80200) 00010000:00010000:0.0:1788201181.903976:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201181.903980:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b786db8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.903985:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b786db8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.904022:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786daa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d5b expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.904032:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:0.0:1788201181.904035:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201181.904046:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b786daa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d5b expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201181.904056:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676f400, rc 0) 00000100:00100000:0.0:1788201181.907270:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:10256:x1875064614053120:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 4519us (5279us total) trans 0 rc 301/301 00000100:00100000:0.0:1788201181.907282:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 36 00000100:00080000:3.0:1788201181.914185:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201181.914257:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201181.914291:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614053376 00000100:00100000:3.0:1788201181.914300:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614053376 00000100:00100000:3.0:1788201181.914348:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 37 00000100:00100000:3.0:1788201181.914358:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:10256:x1875064614053376:12345-192.168.203.14@tcp:36:lfs.0 00010000:00010000:3.0:1788201181.914412:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201181.914438:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786d64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d46 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201181.914455:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:3.0:1788201181.914465:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201181.914728:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786dbf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201181.914742:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786dbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201181.914751:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786dbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201181.914763:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786dc6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201181.914776:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201181.914783:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201181.915717:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1788201181.915729:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786dbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201181.915737:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786dbf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201181.915744:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786dbf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201181.915750:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fdc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201181.915754:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786dbf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201181.915761:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786dbf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201181.915772:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00109a1d00) 00010000:00010000:3.0:1788201181.915775:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201181.915779:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786dbf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201181.915784:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786dbf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201181.915809:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c31db11e reply state 000000000fc67bdd transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201181.915817:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201181.915928:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+10:10256:x1875064614053376:12345-192.168.203.14@tcp:36:lfs.0 Request processed in 1569us (1674us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788201181.915937:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 37 00010000:00010000:3.0:1788201181.921526:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201181.921542:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786dc6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201181.921549:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786dc6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201181.921555:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fcc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201181.921559:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786dc6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201181.921565:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786dc6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201181.921579:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b00109a1500) 00010000:00010000:3.0:1788201181.921582:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201181.921586:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786dc6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201181.921592:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786dc6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201182.050807:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201182.051112:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614053504 00000100:00100000:1.0:1788201182.051122:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614053504 00000100:00100000:1.0:1788201182.052330:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 38 00000100:00100000:1.0:1788201182.052345:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:10265:x1875064614053504:12345-192.168.203.14@tcp:101:lctl.0 00010000:00010000:1.0:1788201182.052375:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201182.052400:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786dcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d62 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.052461:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b786dd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.052474:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b786dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.052497:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b786dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201182.052557:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788201182.052562:0:5828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201182.052603:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b786dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.052627:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786dcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d62 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.052644:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b786dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d62 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.052652:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00033b2000) 00010000:00010000:1.0:1788201182.052655:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201182.052659:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681a00, rc 0) 00000100:00100000:1.0:1788201182.052719:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+10:10265:x1875064614053504:12345-192.168.203.14@tcp:101:lctl.0 Request processed in 379us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201182.052726:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 38 00000100:00100000:1.0:1788201182.137386:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201182.137483:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614053632 00000100:00100000:3.0:1788201182.137493:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614053632 00000100:00100000:3.0:1788201182.137548:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:3.0:1788201182.137559:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+10:10271:x1875064614053632:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:3.0:1788201182.137579:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201182.137596:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786ddb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d69 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.137656:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786de2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.137671:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786de2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.137683:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786de2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.137696:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786de9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.137703:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786de9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.137709:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786de9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.137811:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786df0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.137834:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786df0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.137840:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786df0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201182.137884:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1788201182.137888:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201182.137925:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786df0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.137935:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786de2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.137942:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786de2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.137947:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786de2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.137952:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fdc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201182.137955:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786de2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.137963:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786de2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.137974:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00033b2000) 00010000:00010000:3.0:1788201182.137977:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201182.137981:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786de2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.137998:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786de2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.138010:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786de9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.138016:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786de9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.138021:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786de9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.138025:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fd400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201182.138027:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786de9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.138033:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786de9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.138040:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b00109a1d00) 00010000:00010000:3.0:1788201182.138042:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201182.138044:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786de9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.138049:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786de9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.138076:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786ddb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d69 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.138089:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786df0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d69 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.140953:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:3.0:1788201182.140965:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788201182.140972:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fc200, rc 0) 00000100:00100000:3.0:1788201182.141049:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+11:10271:x1875064614053632:12345-192.168.203.14@tcp:101:bash.0 Request processed in 3486us (3666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201182.141059:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:3.0:1788201182.144958:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201182.145048:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614053888 00000100:00100000:0.0:1788201182.145058:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614053888 00000100:00100000:0.0:1788201182.145123:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:0.0:1788201182.145424:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+11:10271:x1875064614053888:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788201182.145448:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201182.145469:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786df7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d70 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.146313:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786dfe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.146329:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786dfe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.146340:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786dfe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.146408:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786e05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.146416:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786e05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.146423:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786e05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201182.146942:0:5827:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788201182.149978:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786e0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.149999:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.150010:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.150054:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786dfe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.150061:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786dfe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.150067:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786dfe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.150073:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676e000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201182.150077:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786dfe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.150083:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786dfe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.150094:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:0.0:1788201182.150097:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201182.150100:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786dfe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.150121:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786dfe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201182.150151:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005352cd3 reply state 0000000012ae45a6 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786e05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201182.150161:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201182.150205:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b786df7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d70 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.151419:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786e0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d70 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.151429:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0002a80a00) 00010000:00010000:0.0:1788201182.151431:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201182.151434:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676ee00, rc 0) 00000100:00100000:0.0:1788201182.151497:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:10271:x1875064614053888:12345-192.168.203.14@tcp:101:bash.0 Request processed in 6365us (6547us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788201182.151505:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 40 00010000:00010000:3.0:1788201182.154481:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786e05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.154496:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786e05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.154503:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786e05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.154508:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676e400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201182.154512:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786e05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.154519:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786e05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.154533:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b0002a80200) 00010000:00010000:3.0:1788201182.154536:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201182.154540:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786e05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.154546:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b786e05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201182.165594:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201182.165894:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614054016 00000100:00100000:2.0:1788201182.165904:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614054016 00000100:00100000:2.0:1788201182.165954:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:2.0:1788201182.165962:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1875064614054016:12345-192.168.203.14@tcp:8:bash.0 00010000:00080000:2.0:1788201182.165994:0:6677:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:2.0:1788201182.166027:0:6677:0:(genops.c:1406:class_connect()) connect: client aa6eef1a-3f03-469a-ac4c-2a406b6709bc, cookie 0x72011f792b786e1a 00002000:00100000:2.0:1788201182.166038:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aa6eef1a-3f03-469a-ac4c-2a406b6709bc/ffff9b0035dcd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788201182.166059:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788201182.166315:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788201182.166341:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9b0035dcc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201182.166411:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2347:x1875064614054016:12345-192.168.203.14@tcp:8:bash.0 Request processed in 448us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201182.166417:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:0.0:1788201182.174623:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201182.174784:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614054144 00000100:00100000:2.0:1788201182.174794:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614054144 00000100:00100000:2.0:1788201182.174857:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:2.0:1788201182.174867:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:0:x1875064614054144:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:2.0:1788201182.174885:0:7765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201182.174908:0:7765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026b70207/0x72011f792b786e21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d77 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201182.174934:0:7765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201182.174969:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=261s v=(0 0) 00010000:00010000:2.0:1788201182.174978:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201182.174987:0:7765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026b70207/0x72011f792b786e21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d77 expref: 7 pid: 7765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.175006:0:7765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000026b70207/0x72011f792b786e21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d77 expref: 7 pid: 7765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.175019:0:7765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0200, rc 0) 00000100:00100000:2.0:1788201182.175075:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:0:x1875064614054144:12345-192.168.203.14@tcp:101:bash.0 Request processed in 211us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201182.175082:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00080000:3.0:1788201182.175474:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201182.179223:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201182.179301:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614054272 00000100:00100000:2.0:1788201182.179310:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614054272 00000100:00100000:2.0:1788201182.179354:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:2.0:1788201182.179362:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:10271:x1875064614054272:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:2.0:1788201182.179380:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201182.179395:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b786e28 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d7e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.179423:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000026b70207/0x72011f792b786e21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d77 expref: 8 pid: 7765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.179431:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201182.179435:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201182.179440:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b786e28 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d7e expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.179487:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000026b70207/0x72011f792b786e21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d77 expref: 8 pid: 7765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.179500:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000026b70207/0x72011f792b786e21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d77 expref: 8 pid: 7765 timeout: 361 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201182.179514:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1875064622474880:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788201182.179595:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0007ebaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201182.184947:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1875064622474880:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788201182.184981:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b786e28 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d7e expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.185001:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0000, rc 0) 00000100:00100000:2.0:1788201182.185061:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:10271:x1875064614054272:12345-192.168.203.14@tcp:101:bash.0 Request processed in 5699us (5854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201182.185070:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:0.0:1788201182.185275:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201182.185500:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614054400 00000100:00100000:1.0:1788201182.185507:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614054400 00010000:00010000:1.0:1788201182.185537:0:6691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000026b70207/0x72011f792b786e21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d77 expref: 8 pid: 7765 timeout: 361 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201182.185568:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:1.0:1788201182.185577:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2348:x1875064614054400:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201182.185601:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201182.185624:0:6691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000026b70207/0x72011f792b786e21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d77 expref: 8 pid: 7765 timeout: 361 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.185638:0:6691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000026b70207/0x72011f792b786e21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d77 expref: 8 pid: 7765 timeout: 361 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.185661:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026b70207/0x72011f792b786e21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d77 expref: 8 pid: 7765 timeout: 361 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.185675:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201182.185679:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201182.185688:0:6691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b786e28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d7e expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.185699:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b786e28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d7e expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.185729:0:6691:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b786e28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d7e expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201182.185743:0:6691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0003ee7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6691:1875064622475008:192.168.203.14@tcp:105: 00000100:00100000:1.0:1788201182.185842:0:6691:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f5a7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201182.187571:0:6691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0003ee7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6691:1875064622475008:192.168.203.14@tcp:105: 00010000:00010000:1.0:1788201182.187590:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201182.187683:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2348:x1875064614054400:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 2106us (2408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201182.187693:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:3.0:1788201182.188057:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201182.188109:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614054656 00000100:00100000:0.0:1788201182.188116:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614054656 00000100:00100000:0.0:1788201182.188175:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:0.0:1788201182.188184:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:10271:x1875064614054656:12345-192.168.203.14@tcp:35:bash.0 00000001:00080000:0.0:1788201182.188451:0:5830:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:0.0:1788201182.188751:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:10271:x1875064614054656:12345-192.168.203.14@tcp:35:bash.0 Request processed in 567us (694us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788201182.188759:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00000020:00080000:0.0:1788201182.188762:0:5830:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788201182.272800:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201182.272972:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614054912 00000100:00100000:2.0:1788201182.272983:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614054912 00000100:00100000:2.0:1788201182.273052:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 41 00000100:00100000:2.0:1788201182.273064:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:10281:x1875064614054912:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788201182.273088:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201182.273108:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786e2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d85 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201182.273276:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788201182.273394:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786e2f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d85 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.273419:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00033b2000) 00010000:00010000:2.0:1788201182.273423:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201182.273428:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786e2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d85 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.273442:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1600, rc 0) 00000100:00100000:2.0:1788201182.273824:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+16:10281:x1875064614054912:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 760us (1030us total) trans 4294967314 rc 301/301 00000100:00100000:2.0:1788201182.273832:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 41 00000100:00100000:1.0:1788201182.277627:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201182.278733:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614055168 00000100:00100000:2.0:1788201182.278745:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614055168 00000100:00100000:2.0:1788201182.278803:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:2.0:1788201182.278814:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+16:10281:x1875064614055168:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:2.0:1788201182.279089:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+17:10281:x1875064614055168:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 276us (1470us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788201182.279098:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:0.0:1788201182.390231:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201182.391079:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614055296 00000100:00100000:1.0:1788201182.391090:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614055296 00000100:00100000:1.0:1788201182.391188:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:1.0:1788201182.391202:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+17:10287:x1875064614055296:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788201182.391226:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201182.391256:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786e3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d8c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.391331:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b786e44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.391345:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b786e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.391356:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b786e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201182.391414:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1788201182.391418:0:5828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201182.391445:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b786e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.391472:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786e3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d8c expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.391493:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b786e44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d8c expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.391516:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:1.0:1788201182.391519:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201182.391522:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681e00, rc 0) 00000100:00100000:1.0:1788201182.392052:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+18:10287:x1875064614055296:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 854us (1837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201182.392060:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:1.0:1788201182.402420:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201182.402514:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614055552 00000100:00100000:2.0:1788201182.402524:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614055552 00000100:00100000:2.0:1788201182.402587:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:2.0:1788201182.402598:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+18:10287:x1875064614055552:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788201182.402619:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201182.402649:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786e4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d93 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.402755:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786e52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.402770:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.402781:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201182.402809:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788201182.402936:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786e4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d93 expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.402954:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786e52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d93 expref: 20 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.402974:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0002a80a00) 00010000:00010000:2.0:1788201182.402977:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201182.402980:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1200, rc 0) 00000100:00100000:2.0:1788201182.403044:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:10287:x1875064614055552:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 448us (634us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788201182.403051:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:3.0:1788201182.408572:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201182.408619:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201182.408709:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614055936 00000100:00100000:0.0:1788201182.408729:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614055936 00000100:00100000:0.0:1788201182.408808:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:0.0:1788201182.408818:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f614000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:2350:x1875064614055936:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201182.408832:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201182.408865:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786e52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d93 expref: 20 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.408883:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0002a80a00) 00010000:00010000:0.0:1788201182.408887:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201182.408940:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f614000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:2350:x1875064614055936:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 123us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201182.408947:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:1.0:1788201182.409229:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614055808 00000100:00100000:1.0:1788201182.409234:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614055808 00000100:00100000:1.0:1788201182.409268:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:1.0:1788201182.409276:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:10287:x1875064614055808:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788201182.409296:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201182.409311:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786e60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2d9a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.409406:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786e67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.409419:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786e67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.409429:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786e67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201182.409441:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788201182.409563:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786e60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d9a expref: 22 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.409598:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786e67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d9a expref: 21 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.409605:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0002a80a00) 00010000:00010000:1.0:1788201182.409608:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788201182.409610:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681800, rc 0) 00000100:00100000:1.0:1788201182.409645:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:10287:x1875064614055808:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 370us (1025us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788201182.409651:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:3.0:1788201182.428506:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201182.436977:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614056064 00000100:00100000:2.0:1788201182.436992:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614056064 00000100:00100000:2.0:1788201182.437111:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:2.0:1788201182.437147:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2349:x1875064614056064:12345-192.168.203.14@tcp:1:lfs.0 00010000:00010000:2.0:1788201182.437216:0:7765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076dd0387/0x72011f792b786e75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.437236:0:7765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b786e28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d7e expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.437245:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201182.437249:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201182.437254:0:7765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076dd0387/0x72011f792b786e75 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.437289:0:7765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b786e28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d7e expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.437304:0:7765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b786e28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d7e expref: 7 pid: 6677 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201182.437320:0:7765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7765:1875064622475136:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788201182.437436:0:7765:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0007ebaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201182.447010:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201182.447201:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614056192 00000100:00100000:1.0:1788201182.447203:0:7765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7765:1875064622475136:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201182.447207:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614056192 00010000:00010000:1.0:1788201182.447229:0:7765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000076dd0387/0x72011f792b786e75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1788201182.447256:0:6681:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9b00408e0000 x1875064614056192/t0(0) o4->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:303/0 lens 504/0 e 0 to 0 dl 1788201193 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201182.447265:0:6681:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b00408e0000 with x1875064614056192 ext(0->12) 00010000:00010000:3.0:1788201182.447272:0:6681:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b786e28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d7e expref: 8 pid: 6677 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.447285:0:6681:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b786e28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d7e expref: 8 pid: 6677 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201182.447292:0:6681:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b00408e0000 00000100:00100000:3.0:1788201182.447325:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:3.0:1788201182.447335:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2348:x1875064614056192:12345-192.168.203.14@tcp:4:lfs.0 00000001:00100000:2.0:1788201182.502424:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa6eef1a-3f03-469a-ac4c-2a406b6709bc 00000100:00100000:0.0:1788201182.503712:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:2348:x1875064614056192:12345-192.168.203.14@tcp:4:lfs.0 Request processed in 56372us (56704us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788201182.503729:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00002000:00100000:0.0:1788201182.503748:0:6681:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9b00408e0000 x1875064614056192/t4294967299(0) o4->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:303/0 lens 504/448 e 0 to 0 dl 1788201193 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201182.503758:0:6681:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b00408e0000 with x1875064614056192 ext(0->12) 00010000:00010000:0.0:1788201182.503768:0:6681:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b786e28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d7e expref: 9 pid: 6677 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.503800:0:6681:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b786e28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d7e expref: 9 pid: 6677 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201182.503809:0:6681:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b00408e0000 00000100:00100000:3.0:1788201182.512606:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201182.512687:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614056320 00000100:00100000:2.0:1788201182.512827:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614056320 00010000:00010000:2.0:1788201182.512879:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b786e28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d7e expref: 9 pid: 6677 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201182.512968:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 36 00000100:00100000:2.0:1788201182.512990:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:2349:x1875064614056320:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201182.513005:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788201182.513022:0:5812:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788201182.513025:0:5812:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788201182 00002000:00010000:2.0:1788201182.513027:0:5812:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788201182 00002000:00010000:2.0:1788201182.513029:0:5812:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788201182 00010000:00010000:2.0:1788201182.513034:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b786e28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d7e expref: 9 pid: 6677 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.513048:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b786e28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d7e expref: 9 pid: 6677 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.513069:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b786e28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d7e expref: 9 pid: 6677 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.513084:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201182.513089:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201182.513094:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000076dd0387/0x72011f792b786e75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.513103:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076dd0387/0x72011f792b786e75 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.513130:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201182.514224:0:7765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000076dd0387/0x72011f792b786e75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.514238:0:7765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076dd0387/0x72011f792b786e75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.514267:0:7765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076dd0387/0x72011f792b786e75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.514274:0:7765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076dd0387/0x72011f792b786e75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.514281:0:7765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076dd0387/0x72011f792b786e75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.514288:0:7765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1600 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201182.514291:0:7765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076dd0387/0x72011f792b786e75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.514299:0:7765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076dd0387/0x72011f792b786e75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.514341:0:7765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076dd0387/0x72011f792b786e75 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.514349:0:7765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076dd0387/0x72011f792b786e75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201182.523174:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2349:x1875064614056064:12345-192.168.203.14@tcp:1:lfs.0 Request processed in 86042us (94664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201182.523188:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:2.0:1788201182.525449:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2349:x1875064614056320:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 12449us (12840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201182.525462:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 36 00000100:00100000:3.0:1788201182.530051:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201182.530759:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614056576 00000100:00100000:2.0:1788201182.530769:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614056576 00000100:00100000:2.0:1788201182.530828:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:2.0:1788201182.530840:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:10287:x1875064614056576:12345-192.168.203.14@tcp:35:lfs.0 00000004:00010000:2.0:1788201182.531125:0:5831:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786e67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d9a expref: 21 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201182.531609:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788201182.532071:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1788201182.534463:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:2.0:1788201182.534557:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786e7c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.534578:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786e0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d70 expref: 25 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.534587:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786e7c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.534627:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786e0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d70 expref: 25 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.535202:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786e0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d70 expref: 25 pid: 5827 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201182.535283:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5831:1875064622475264:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788201182.535391:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00081bc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201182.539707:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201182.540079:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614056704 00000100:00100000:0.0:1788201182.540087:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614056704 00010000:00010000:0.0:1788201182.540124:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786e0c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d70 expref: 26 pid: 5827 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201182.540185:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 37 00000100:00100000:0.0:1788201182.540194:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:2348:x1875064614056704:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201182.540216:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201182.540223:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786e0c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d70 expref: 26 pid: 5827 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.540236:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786e0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d70 expref: 26 pid: 5827 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.540256:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0002a80a00) 00010000:00010000:0.0:1788201182.540261:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786e7c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.540282:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786e7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.540288:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786e7c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201182.540316:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201182.540368:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:2348:x1875064614056704:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 175us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201182.540376:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 37 00010000:00010000:2.0:1788201182.541599:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786e0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d70 expref: 25 pid: 5827 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201182.541647:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5831:1875064622475264:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788201182.541669:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786e7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.541678:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786e7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.541684:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786e7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201182.541825:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:2.0:1788201182.542036:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788201182.542183:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5831:1875064622475392:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788201182.542269:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201182.542295:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00081bca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201182.542726:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622475392 00000100:00100000:1.0:1788201182.542741:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622475392 00000100:00080000:3.0:1788201182.542868:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201182.542989:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201182.543001:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5831:x1875064622475392:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788201182.543089:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5831:x1875064622475392:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 90us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201182.543096:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201182.543201:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5831:1875064622475392:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788201182.544416:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1788201182.544496:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5831:1875064622475520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788201182.544545:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201182.545564:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00081bca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201182.545601:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622475520 00000100:00100000:0.0:1788201182.545608:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622475520 00000100:00100000:0.0:1788201182.545714:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201182.545964:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1875064622475520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788201182.546397:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1875064622475520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 437us (1850us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788201182.546405:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201182.546495:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5831:1875064622475520:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788201182.546557:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788201182.546597:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786e7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.546608:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786e7c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.546626:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786e7c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.546699:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201182.546704:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786e7c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.546711:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786e7c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.546725:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0002a80a00) 00010000:00010000:2.0:1788201182.546728:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788201182.546733:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786e7c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.546799:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b786e7c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201182.547384:0:5831:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788201182.547614:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788201182.547624:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 261672490137ns, next at 262672488445ns, rc = 0 00000001:00080000:2.0:1788201182.547818:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1788201182.548445:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0002a80a00) 00010000:00010000:2.0:1788201182.548448:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788201182.548458:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786e67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d9a expref: 29 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201182.548557:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:10287:x1875064614056576:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 17719us (18514us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788201182.548580:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00000020:00080000:2.0:1788201182.548585:0:5831:0:(tgt_main.c:807:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788201182.552098:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201182.552457:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614056832 00000100:00100000:2.0:1788201182.552466:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614056832 00000100:00100000:2.0:1788201182.552563:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:2.0:1788201182.552574:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:10287:x1875064614056832:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788201182.552599:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201182.552623:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b786e83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2da1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.552692:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b786e83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2da1 expref: 29 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.552707:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b786e83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2da1 expref: 29 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201182.552727:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:2.0:1788201182.552730:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201182.552733:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1800, rc 0) 00000100:00100000:2.0:1788201182.552861:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+29:10287:x1875064614056832:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 289us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201182.552869:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:1.0:1788201182.559832:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201182.561641:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614057088 00000100:00100000:3.0:1788201182.561653:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614057088 00000100:00100000:3.0:1788201182.561719:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:3.0:1788201182.561731:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00228e0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+29:10287:x1875064614057088:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:3.0:1788201182.561995:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00228e0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+30:10287:x1875064614057088:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 265us (2169us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1788201182.562003:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00010000:00010000:2.0:1788201182.667447:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201182.673270:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201182.673365:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614057344 00000100:00100000:1.0:1788201182.673374:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614057344 00000100:00100000:1.0:1788201182.673436:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:1.0:1788201182.673462:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+30:10297:x1875064614057344:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788201182.673491:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201182.673512:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b786e8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2da8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201182.673628:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1788201182.673884:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b786e8a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2da8 expref: 32 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.673900:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00033b2000) 00010000:00010000:1.0:1788201182.673903:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201182.673908:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b786e8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2da8 expref: 32 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.673923:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680e00, rc 0) 00000100:00100000:1.0:1788201182.673998:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:10297:x1875064614057344:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 538us (737us total) trans 4294967328 rc 301/301 00000100:00100000:1.0:1788201182.674006:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:0.0:1788201182.676564:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201182.676902:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614057472 00000100:00100000:3.0:1788201182.676912:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614057472 00000100:00100000:3.0:1788201182.676969:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 47 00000100:00100000:3.0:1788201182.676980:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:10297:x1875064614057472:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:3.0:1788201182.677053:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786e98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677069:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786e98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677080:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786e98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677096:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786e9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677103:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786e9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677110:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786e9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677242:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ea6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677257:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677263:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201182.677311:0:9471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677324:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786e98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677331:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786e98 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677337:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786e98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677343:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fcc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201182.677347:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786e98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677353:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786e98 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677364:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:3.0:1788201182.677367:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201182.677371:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786e98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677376:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786e98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677395:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786e9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677401:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786e9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677405:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786e9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677410:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fd400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201182.677413:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786e9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677418:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786e9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677425:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b00109a1d00) 00010000:00010000:3.0:1788201182.677427:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201182.677429:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786e9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677435:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786e9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677449:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677454:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ea6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677459:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ea6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677469:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fdc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201182.677471:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ea6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677477:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ea6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677484:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:3.0:1788201182.677486:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201182.677489:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ea6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.677493:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ea6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201182.677551:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:10297:x1875064614057472:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 573us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201182.677558:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 47 00000100:00100000:0.0:1788201182.684069:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201182.684383:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614057728 00000100:00100000:3.0:1788201182.684397:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614057728 00000100:00100000:1.0:1788201182.685012:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:1.0:1788201182.685028:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:10297:x1875064614057728:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788201182.685381:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:10297:x1875064614057728:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 358us (1327us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788201182.685390:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:0.0:1788201182.745806:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201182.745925:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614057984 00000100:00100000:1.0:1788201182.745938:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614057984 00000100:00100000:1.0:1788201182.746017:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:1.0:1788201182.746048:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:10300:x1875064614057984:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788201182.746084:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201182.746112:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b786ead lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2daf expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746285:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786eb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746304:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786eb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746318:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786eb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746335:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786ebb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746341:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746347:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746522:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786ec2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746531:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746537:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201182.746561:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788201182.746690:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786eb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746699:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786eb4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746705:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746712:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201182.746716:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746725:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786eb4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746738:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:1.0:1788201182.746741:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201182.746746:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786eb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746753:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786eb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746767:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746773:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786ebb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746790:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786ebb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746796:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201182.746798:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786ebb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746805:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786ebb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746813:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b00033b2100) 00010000:00010000:1.0:1788201182.746816:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201182.746819:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786ebb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746824:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786ebb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746893:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b786ead lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2daf expref: 35 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746910:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2daf expref: 34 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201182.746918:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:1.0:1788201182.746920:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201182.746922:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681600, rc 0) 00000100:00100000:1.0:1788201182.747016:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+34:10300:x1875064614057984:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 970us (1229us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788201182.747035:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:0.0:1788201182.751779:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201182.751975:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614058112 00000100:00100000:3.0:1788201182.751988:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614058112 00000100:00100000:3.0:1788201182.752114:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:3.0:1788201182.752126:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+34:10300:x1875064614058112:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:3.0:1788201182.752416:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ed0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.752439:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.752486:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.752525:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.752532:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ed0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.752539:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.752546:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fdc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201182.752551:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.752560:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ed0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.752574:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:3.0:1788201182.752577:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201182.752583:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ed0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201182.752589:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786ed0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201182.752672:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+34:10300:x1875064614058112:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 547us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201182.752680:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:2.0:1788201182.767040:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201182.767188:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614058368 00000100:00100000:1.0:1788201182.767200:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614058368 00000100:00100000:1.0:1788201182.767372:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:1.0:1788201182.767387:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+34:10300:x1875064614058368:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788201182.767765:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:10300:x1875064614058368:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 380us (737us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788201182.767775:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:0.0:1788201183.153422:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201183.153798:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614058624 00000100:00100000:1.0:1788201183.153807:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614058624 00000100:00100000:1.0:1788201183.153927:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 50 00000100:00100000:1.0:1788201183.153937:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:10331:x1875064614058624:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:1.0:1788201183.153962:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201183.153982:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b786ed7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2db6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.154079:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786ede lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.154095:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786ede lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.154108:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786ede lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201183.154119:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788201183.154296:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b786ed7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2db6 expref: 38 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.154346:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786ede lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2db6 expref: 37 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.154355:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:1.0:1788201183.154357:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201183.154361:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680600, rc 0) 00000100:00100000:1.0:1788201183.154420:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+37:10331:x1875064614058624:12345-192.168.203.14@tcp:101:cat.0 Request processed in 484us (1107us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788201183.154428:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 50 00000100:00080000:3.0:1788201183.154983:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201183.175954:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201183.176857:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614058880 00000100:00100000:1.0:1788201183.176867:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614058880 00000100:00100000:1.0:1788201183.176922:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:1.0:1788201183.176931:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+37:10331:x1875064614058880:12345-192.168.203.14@tcp:35:cat.0 00000100:00100000:1.0:1788201183.177171:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+38:10331:x1875064614058880:12345-192.168.203.14@tcp:35:cat.0 Request processed in 241us (1224us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788201183.177179:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:2.0:1788201183.184262:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201183.184374:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614059008 00000100:00100000:0.0:1788201183.184383:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614059008 00000100:00100000:0.0:1788201183.184939:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:0.0:1788201183.184951:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006798450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+38:2350:x1875064614059008:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201183.184980:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201183.185004:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b786ede lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2db6 expref: 38 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201183.185023:0:6691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:0.0:1788201183.185028:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201183.185084:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006798450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+37:2350:x1875064614059008:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 136us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201183.185092:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:0.0:1788201183.250253:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201183.250354:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614059264 00000100:00100000:2.0:1788201183.250365:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614059264 00000100:00100000:2.0:1788201183.250440:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00100000:2.0:1788201183.250449:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+37:10337:x1875064614059264:12345-192.168.203.14@tcp:101:dd.0 00010000:00010000:2.0:1788201183.250471:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201183.250474:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788201183.250500:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b786e44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d8c expref: 37 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.250518:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:2.0:1788201183.250523:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201183.250536:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786eec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2dbd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.250627:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786ef3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.250642:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786ec2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2daf expref: 37 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.250650:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786ef3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.250682:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2daf expref: 37 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.250703:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2daf expref: 37 pid: 5827 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201183.250716:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5829:1875064622475648:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788201183.250829:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0007eba480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201183.256852:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201183.257498:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614059392 00000100:00100000:1.0:1788201183.257509:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614059392 00010000:00010000:1.0:1788201183.257557:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786ec2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2daf expref: 38 pid: 5827 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201183.257599:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 38 00000100:00100000:1.0:1788201183.257607:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+38:2348:x1875064614059392:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201183.257623:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201183.257644:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786ec2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2daf expref: 38 pid: 5827 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.257657:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2daf expref: 38 pid: 5827 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.257680:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:1.0:1788201183.257685:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786ef3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.257696:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786ef3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.257703:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786ef3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.257721:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201183.257772:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+38:2348:x1875064614059392:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 166us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201183.257780:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 38 00010000:00010000:2.0:1788201183.262171:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786ec2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2daf expref: 37 pid: 5827 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201183.262197:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5829:1875064622475648:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788201183.262242:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786ef3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.262252:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786ef3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.262268:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786ef3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201183.262290:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788201183.262457:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786eec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dbd expref: 38 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.262473:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786ef3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dbd expref: 37 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.262482:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:2.0:1788201183.262484:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788201183.262487:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1200, rc 0) 00000100:00100000:2.0:1788201183.262559:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+37:10337:x1875064614059264:12345-192.168.203.14@tcp:101:dd.0 Request processed in 12111us (12314us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788201183.262568:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00100000:0.0:1788201183.268097:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201183.268317:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614059648 00000100:00100000:1.0:1788201183.268326:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614059648 00000100:00100000:1.0:1788201183.268384:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:1.0:1788201183.268395:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+37:10337:x1875064614059648:12345-192.168.203.14@tcp:36:dd.0 00010000:00010000:1.0:1788201183.268676:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b786f01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.268694:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b786f01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.268705:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b786f01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201183.268772:0:5827:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:1.0:1788201183.268798:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074a5633a reply state 00000000c2d06fe3 transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b786f01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201183.268806:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201183.268908:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+40:10337:x1875064614059648:12345-192.168.203.14@tcp:36:dd.0 Request processed in 514us (819us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788201183.268915:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 52 00000020:00080000:1.0:1788201183.268920:0:5827:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788201183.270805:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b786f01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201183.270820:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b786f01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201183.270827:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b786f01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201183.270834:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201183.270846:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b786f01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201183.270854:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b786f01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201183.270868:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:0.0:1788201183.270882:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201183.270888:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b786f01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201183.270893:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b786f01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788201183.598992:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967313 is committed 00000001:00080000:0.0:1788201183.599013:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967336 is committed 00000004:00080000:0.0:1788201183.599036:0:5849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788201183.599062:0:5849:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b0006315cc0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788201183.599066:0:5849:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b003f578900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b00063156c0 00000020:00080000:0.0:1788201183.599070:0:5849:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b003f578100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b003fdfd400 00000100:00100000:0.0:1788201183.599425:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201183.599445:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622475776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201183.599520:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201183.600239:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622475776 00000100:00100000:3.0:1788201183.600246:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622475776 00000100:00100000:3.0:1788201183.600300:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201183.600310:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3292:x1875064622475776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201183.600350:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788201183.600382:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a95c8de, atime: 0x6a95c8de, ctime: 0x6a95c8de, blocks: 0x1 00010000:00010000:3.0:1788201183.600391:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f37a298/0x72011f792b786f08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201183.600408:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=262s v=(0 0) 00010000:00010000:3.0:1788201183.600412:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201183.600418:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f37a298/0x72011f792b786f08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201183.600433:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f37a298/0x72011f792b786f08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201183.600442:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f37a298/0x72011f792b786f08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201183.600449:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f37a298/0x72011f792b786f08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201183.600464:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201183.601211:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3292:x1875064622475776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 901us (1689us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788201183.601222:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788201183.601323:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201183.601329:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f37a298/0x72011f792b786f08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.601340:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fd400 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201183.601344:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f37a298/0x72011f792b786f08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.601353:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f37a298/0x72011f792b786f08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.601369:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f37a298/0x72011f792b786f08 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.601376:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f37a298/0x72011f792b786f08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.601395:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201183.601402:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201183.601404:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201183.601831:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0035c04e00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788201183.601849:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622475776:0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1788201183.601915:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788201183.602001:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:3.0:1788201183.692197:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201183.719732:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201183.719942:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614059776 00000100:00100000:3.0:1788201183.719952:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614059776 00000100:00100000:3.0:1788201183.720011:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:3.0:1788201183.720021:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+11:10351:x1875064614059776:12345-192.168.203.14@tcp:101:stat.0 00010000:00010000:3.0:1788201183.720045:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201183.720066:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786f0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2dc4 expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201183.720127:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786f16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201183.720176:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786f16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201183.720187:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786f16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201183.720203:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786f1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201183.720210:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786f1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201183.720217:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786f1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201183.720953:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b786f24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201183.720969:0:9471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786ef3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dbd expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201183.720991:0:9471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b786f24 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201183.721024:0:9471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786ef3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dbd expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201183.721039:0:9471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786ef3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dbd expref: 12 pid: 5829 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201183.721053:0:9471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c05500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9471:1875064622475904:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201183.721207:0:9471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9aff01b6b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201183.739386:0:9471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c05500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9471:1875064622475904:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201183.739415:0:9471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b786f24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201183.740047:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201183.746360:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614060032 00000100:00100000:1.0:1788201183.746375:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614060032 00000100:00100000:1.0:1788201183.746457:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:1.0:1788201183.746468:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:5586:x1875064614060032:12345-192.168.203.14@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788201183.747191:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:5586:x1875064614060032:12345-192.168.203.14@tcp:35:ldlm_bl.0 Request processed in 723us (7143us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1788201183.747269:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:3.0:1788201183.750370:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201183.750475:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614060160 00000100:00100000:2.0:1788201183.750484:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614060160 00010000:00010000:2.0:1788201183.750703:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786ef3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dbd expref: 14 pid: 5829 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201183.750918:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:2.0:1788201183.750930:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:2349:x1875064614060160:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201183.750946:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201183.750954:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786ef3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dbd expref: 14 pid: 5829 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.750968:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786ef3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dbd expref: 14 pid: 5829 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.750990:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786ef3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dbd expref: 14 pid: 5829 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.751006:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:2.0:1788201183.751011:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b786f24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.751021:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b786f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.751029:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b786f24 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.751063:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201183.751169:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:2349:x1875064614060160:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 203us (770us total) trans 0 rc 0/0 00010000:00010000:1.0:1788201183.751235:0:9471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b786f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751244:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b786f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201183.751288:0:9471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788201183.751293:0:9471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201183.751332:0:9471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b786f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751344:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b786f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751354:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786f16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751361:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786f16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751375:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786f16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751382:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fcc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201183.751386:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786f16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751395:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786f16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751404:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:1.0:1788201183.751408:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201183.751412:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786f16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751419:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b786f16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751431:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786f1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751451:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786f1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751458:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786f1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751463:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fd400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201183.751466:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786f1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751483:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786f1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751505:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b00109a1c00) 00010000:00010000:1.0:1788201183.751508:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201183.751512:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786f1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751518:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b786f1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751556:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b786f0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dc4 expref: 14 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751571:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b786f24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dc4 expref: 13 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.751579:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:1.0:1788201183.751581:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201183.751583:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c7800, rc 0) 00000100:00100000:1.0:1788201183.751612:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:10351:x1875064614059776:12345-192.168.203.14@tcp:101:stat.0 Request processed in 31593us (31889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201183.751620:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:2.0:1788201183.754374:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:0.0:1788201183.840304:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201183.841182:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614060416 00000100:00100000:1.0:1788201183.841192:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614060416 00000100:00100000:1.0:1788201183.841352:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00100000:1.0:1788201183.841362:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+12:10357:x1875064614060416:12345-192.168.203.14@tcp:36:truncate.0 00010000:00010000:1.0:1788201183.841444:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201183.841470:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b786f24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dc4 expref: 12 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.841490:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:1.0:1788201183.841503:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201183.841716:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.841731:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201183.841741:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201183.841802:0:5827:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:1.0:1788201183.841829:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000921e35a9 reply state 00000000f58f5067 transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201183.841850:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201183.841974:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:10357:x1875064614060416:12345-192.168.203.14@tcp:36:truncate.0 Request processed in 613us (2277us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1788201183.841982:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 54 00000020:00080000:1.0:1788201183.841987:0:5827:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788201183.844327:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.844343:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.844350:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.844356:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201183.844361:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.844368:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.844383:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:2.0:1788201183.844387:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201183.844391:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201183.844398:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201184.028118:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201184.028197:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201184.028229:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201184.028274:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614060800 00000100:00100000:0.0:1788201184.028284:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614060800 00000100:00100000:0.0:1788201184.028344:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 120 00000100:00100000:0.0:1788201184.028355:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2349:x1875064614060800:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201184.028441:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2349:x1875064614060800:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201184.028449:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 120 00000100:00080000:0.0:1788201184.028471:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201184.028895:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614060544 00000100:00100000:3.0:1788201184.028900:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614060544 00000100:00100000:3.0:1788201184.028932:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 280 00000100:00100000:3.0:1788201184.028939:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2349:x1875064614060544:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201184.028983:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2349:x1875064614060544:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 35us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201184.028989:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 280 00000100:00100000:1.0:1788201184.030430:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614060672 00000100:00100000:1.0:1788201184.030440:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614060672 00000100:00100000:1.0:1788201184.030503:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00100000:1.0:1788201184.030514:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2349:x1875064614060672:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201184.030572:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2349:x1875064614060672:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 61us (2464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201184.030589:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00080000:0.0:1788201184.031061:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201184.085628:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201184.085752:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614060928 00000100:00100000:3.0:1788201184.085762:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614060928 00000100:00100000:3.0:1788201184.085816:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 55 00000100:00100000:3.0:1788201184.085827:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:10371:x1875064614060928:12345-192.168.203.14@tcp:101:stat.0 00010000:00010000:3.0:1788201184.085860:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201184.085878:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b786f32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2dcb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.085955:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b786f39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.085969:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b786f39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.085981:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b786f39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.085996:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086003:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086010:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086478:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b786f47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086488:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b786f47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086495:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b786f47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201184.086529:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788201184.086534:0:5828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201184.086555:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b786f47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086575:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b786f47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086584:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b786f39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086591:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b786f39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086598:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b786f39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086605:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201184.086609:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b786f39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086616:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b786f39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086627:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:3.0:1788201184.086630:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201184.086634:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b786f39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086639:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b786f39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086653:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086659:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086863:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086871:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201184.086874:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086881:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086890:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b00109a1200) 00010000:00010000:3.0:1788201184.086892:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201184.086896:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086902:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086933:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b786f32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dcb expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086947:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b786f47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dcb expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.086955:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:3.0:1788201184.086957:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201184.086960:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c6000, rc 0) 00000100:00100000:3.0:1788201184.087012:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:10371:x1875064614060928:12345-192.168.203.14@tcp:101:stat.0 Request processed in 1187us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201184.087029:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 55 00000100:00100000:0.0:1788201184.197286:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201184.197416:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614061184 00000100:00100000:2.0:1788201184.197430:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614061184 00000100:00100000:2.0:1788201184.197511:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 56 00000100:00100000:2.0:1788201184.197524:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:10381:x1875064614061184:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788201184.197573:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201184.197599:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786f4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2dd2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201184.197978:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1788201184.198230:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786f4e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dd2 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.198248:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00033b2000) 00010000:00010000:2.0:1788201184.198252:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201184.198257:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786f4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dd2 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.198272:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1200, rc 0) 00000100:00100000:2.0:1788201184.198356:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:10381:x1875064614061184:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 835us (1087us total) trans 4294967340 rc 301/301 00000100:00100000:2.0:1788201184.198364:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 56 00000100:00100000:0.0:1788201184.206075:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201184.206223:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614061440 00000100:00100000:1.0:1788201184.206236:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614061440 00000100:00100000:1.0:1788201184.206304:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:1.0:1788201184.206317:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:10381:x1875064614061440:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788201184.206965:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+16:10381:x1875064614061440:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 648us (901us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1788201184.206974:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:3.0:1788201184.275188:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201184.275414:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614061696 00000100:00100000:1.0:1788201184.275427:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614061696 00000100:00100000:1.0:1788201184.275503:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:1.0:1788201184.275514:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+16:10387:x1875064614061696:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788201184.275547:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201184.275574:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b786f5c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2dd9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.275720:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.275737:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b786f47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dcb expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.275747:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f63 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.275790:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b786f47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dcb expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.275829:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b786f47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dcb expref: 17 pid: 5828 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201184.275878:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0003ee4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5827:1875064622476032:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201184.276007:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00104f8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201184.281313:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0003ee4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5827:1875064622476032:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201184.281357:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201184.282912:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201184.283397:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614061824 00000100:00100000:1.0:1788201184.283409:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614061824 00010000:00010000:1.0:1788201184.283461:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b786f47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dcb expref: 18 pid: 5828 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201184.283511:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:1.0:1788201184.283522:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+18:2349:x1875064614061824:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201184.283540:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201184.283549:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b786f47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dcb expref: 18 pid: 5828 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.283564:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b786f47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dcb expref: 18 pid: 5828 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.283589:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b786f47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dcb expref: 18 pid: 5828 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.283647:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:1.0:1788201184.283653:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.283665:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.283674:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f63 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.283714:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201184.283778:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+17:2349:x1875064614061824:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 257us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201184.283785:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 40 00010000:00010000:2.0:1788201184.283868:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.283877:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201184.283901:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788201184.284105:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b786f5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dd9 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.284124:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dd9 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.284312:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:2.0:1788201184.284316:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788201184.284319:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681800, rc 0) 00000100:00100000:2.0:1788201184.284352:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+17:10387:x1875064614061696:12345-192.168.203.14@tcp:101:bash.0 Request processed in 8840us (9238us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788201184.284360:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:0.0:1788201184.288661:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201184.288757:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614062080 00000100:00100000:2.0:1788201184.288768:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614062080 00000100:00100000:2.0:1788201184.288843:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 58 00000100:00100000:2.0:1788201184.288855:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+17:10387:x1875064614062080:12345-192.168.203.14@tcp:36:bash.0 00010000:00010000:2.0:1788201184.289259:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786f71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.289280:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786f71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.289293:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786f71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201184.289351:0:5829:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:2.0:1788201184.289379:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f08157e reply state 00000000240dcc55 transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786f71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201184.289389:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201184.289489:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:10387:x1875064614062080:12345-192.168.203.14@tcp:36:bash.0 Request processed in 635us (840us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788201184.289496:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 58 00000020:00080000:2.0:1788201184.289522:0:5829:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788201184.291348:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786f71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.291366:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786f71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.291374:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786f71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.291382:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201184.291388:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786f71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.291397:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786f71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.291417:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:0.0:1788201184.291421:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201184.291427:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786f71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.291434:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b786f71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201184.296783:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201184.297171:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614062208 00000100:00100000:3.0:1788201184.297184:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614062208 00000100:00100000:3.0:1788201184.297271:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:3.0:1788201184.297283:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:10387:x1875064614062208:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:3.0:1788201184.297314:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201184.297340:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b786f78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2de0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.297473:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.297490:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f63 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dd9 expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.297501:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f7f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.297544:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dd9 expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.297559:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dd9 expref: 20 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201184.297576:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c07480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5828:1875064622476160:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201184.297692:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9aff01b6ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201184.300755:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201184.300907:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614062336 00000100:00100000:1.0:1788201184.300919:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614062336 00010000:00010000:1.0:1788201184.300965:0:6691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f63 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dd9 expref: 21 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201184.301016:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 41 00000100:00100000:1.0:1788201184.301028:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f614000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:2349:x1875064614062336:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201184.301045:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201184.301052:0:6691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f63 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dd9 expref: 21 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.301066:0:6691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dd9 expref: 21 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.301116:0:6691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:1.0:1788201184.301122:0:6691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.301174:0:6691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.301183:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f7f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.301214:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201184.301285:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f614000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:2349:x1875064614062336:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 258us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201184.301294:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 41 00010000:00010000:0.0:1788201184.302269:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b786f63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dd9 expref: 20 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201184.302291:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c07480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5828:1875064622476160:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788201184.302318:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.302329:0:5828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.302336:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201184.302391:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788201184.302396:0:5828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201184.302420:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.302458:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b786f78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2de0 expref: 20 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.302476:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2de0 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.302486:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:0.0:1788201184.302489:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201184.302492:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c6a00, rc 0) 00000100:00100000:0.0:1788201184.302564:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:10387:x1875064614062208:12345-192.168.203.14@tcp:101:bash.0 Request processed in 5283us (5794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201184.302573:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:3.0:1788201184.305502:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201184.305809:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614062592 00000100:00100000:2.0:1788201184.305821:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614062592 00000100:00100000:2.0:1788201184.305903:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:2.0:1788201184.305915:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00228e1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:10387:x1875064614062592:12345-192.168.203.14@tcp:35:bash.0 00000100:00100000:2.0:1788201184.306261:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00228e1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:10387:x1875064614062592:12345-192.168.203.14@tcp:35:bash.0 Request processed in 347us (770us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788201184.306270:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:3.0:1788201184.419475:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201184.421394:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614062848 00000100:00100000:2.0:1788201184.421415:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614062848 00000100:00100000:3.0:1788201184.421921:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:3.0:1788201184.421935:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:10397:x1875064614062848:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788201184.421971:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201184.421997:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b786f86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2de7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201184.422440:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1788201184.422797:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b786f86 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2de7 expref: 22 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.422816:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00033b2000) 00010000:00010000:3.0:1788201184.422820:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201184.422826:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b786f86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2de7 expref: 22 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201184.422853:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c7a00, rc 0) 00000100:00100000:3.0:1788201184.423232:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:10397:x1875064614062848:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1199us (3670us total) trans 4294967346 rc 301/301 00000100:00100000:3.0:1788201184.423244:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:3.0:1788201184.426793:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201184.426972:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614062976 00000100:00100000:2.0:1788201184.426984:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614062976 00000100:00100000:2.0:1788201184.427048:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:2.0:1788201184.427065:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:10397:x1875064614062976:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:2.0:1788201184.427179:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786f94 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.427205:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786f94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.427218:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786f94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.427235:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b786f9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.427242:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b786f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.427248:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b786f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.427876:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786fa2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.427887:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.427894:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201184.427949:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.427963:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786f94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.427970:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786f94 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.427976:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786f94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.427983:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201184.427988:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786f94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.427996:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786f94 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.428009:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:2.0:1788201184.428012:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201184.428017:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786f94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.428032:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b786f94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.428047:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b786f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.428053:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b786f9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.428119:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b786f9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.428125:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201184.428129:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b786f9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.428158:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b786f9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.428167:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b0011cb3b00) 00010000:00010000:2.0:1788201184.428170:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201184.428172:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b786f9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.428178:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b786f9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.428297:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.428304:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786fa2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.428318:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.428323:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201184.428326:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.428333:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786fa2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.428342:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:2.0:1788201184.428345:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201184.428348:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786fa2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.428354:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b786fa2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201184.428587:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:10397:x1875064614062976:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 1525us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201184.428597:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:1.0:1788201184.432850:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201184.435333:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614063232 00000100:00100000:2.0:1788201184.435356:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614063232 00000100:00100000:2.0:1788201184.435516:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:2.0:1788201184.435529:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:10397:x1875064614063232:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:2.0:1788201184.436171:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:10397:x1875064614063232:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 641us (3341us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788201184.436181:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:3.0:1788201184.481291:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201184.481509:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614063488 00000100:00100000:0.0:1788201184.481522:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614063488 00000100:00100000:0.0:1788201184.481595:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 62 00000100:00100000:0.0:1788201184.481607:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:10400:x1875064614063488:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788201184.481650:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201184.481676:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786fa9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2dee expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.481784:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786fb0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.481801:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786fb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.481814:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786fb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.481839:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786fb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.481848:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.481855:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.483486:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b786fbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.483526:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b786fbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.483538:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b786fbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201184.483553:0:9471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788201184.483692:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786fb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.483701:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786fb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.483708:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786fb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.484271:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201184.484280:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786fb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.484291:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786fb0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.484308:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:0.0:1788201184.484311:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201184.484317:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786fb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.484324:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786fb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.484342:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.484361:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786fb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.484367:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.484371:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676ee00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201184.484374:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.484381:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786fb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.484390:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b0002a80200) 00010000:00010000:0.0:1788201184.484392:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201184.484395:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786fb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.484401:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786fb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.484696:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b786fa9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dee expref: 25 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.484871:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b786fbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dee expref: 24 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.484881:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:1.0:1788201184.484884:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201184.484886:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676f000, rc 0) 00000100:00100000:1.0:1788201184.485870:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+24:10400:x1875064614063488:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 4257us (4587us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788201184.485884:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 62 00000100:00100000:3.0:1788201184.491191:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201184.492404:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201184.492516:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614063744 00000100:00100000:2.0:1788201184.492529:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614063744 00000100:00100000:2.0:1788201184.492607:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:2.0:1788201184.492630:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040678380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+24:2348:x1875064614063744:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201184.492651:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201184.492682:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b786fbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dee expref: 24 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201184.492706:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:2.0:1788201184.492712:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201184.493222:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614063616 00000100:00100000:1.0:1788201184.493229:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614063616 00000100:00100000:1.0:1788201184.493272:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 63 00000100:00100000:1.0:1788201184.493281:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+24:10400:x1875064614063616:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:1.0:1788201184.493356:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786fcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.493374:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786fcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.493386:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786fcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.493422:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786fcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.493430:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786fcc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.493437:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786fcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.493444:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201184.493449:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786fcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.493458:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786fcc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.493480:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:1.0:1788201184.493483:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201184.493488:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786fcc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.493515:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b786fcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201184.494144:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040678380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+24:2348:x1875064614063744:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 1509us (1729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201184.494155:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:1.0:1788201184.495862:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+23:10400:x1875064614063616:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 2567us (4672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201184.495878:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 63 00000100:00100000:2.0:1788201184.503785:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201184.503940:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614064000 00000100:00100000:0.0:1788201184.503954:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614064000 00000100:00100000:0.0:1788201184.504026:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:0.0:1788201184.504038:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+23:10400:x1875064614064000:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:0.0:1788201184.504694:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+24:10400:x1875064614064000:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 654us (920us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788201184.504703:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:3.0:1788201184.662123:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201184.662515:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614064256 00000100:00100000:0.0:1788201184.662547:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614064256 00000100:00100000:0.0:1788201184.662630:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 64 00000100:00100000:0.0:1788201184.662644:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+24:10418:x1875064614064256:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:0.0:1788201184.662676:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201184.662704:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786fd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2df5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.662853:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786fda lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.662872:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786fda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.662884:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786fda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201184.662897:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788201184.663062:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786fd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2df5 expref: 27 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.663085:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786fda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2df5 expref: 26 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.663095:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:0.0:1788201184.663098:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788201184.663101:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676f800, rc 0) 00000100:00100000:0.0:1788201184.663428:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:10418:x1875064614064256:12345-192.168.203.14@tcp:101:cat.0 Request processed in 786us (1318us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788201184.663437:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 64 00000100:00100000:3.0:1788201184.696205:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201184.696520:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614064384 00000100:00100000:0.0:1788201184.696533:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614064384 00000100:00100000:0.0:1788201184.696609:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 65 00000100:00100000:0.0:1788201184.696631:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:10419:x1875064614064384:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788201184.696661:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201184.696686:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786fe8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2dfc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.696797:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b786fef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.696824:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b786fef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.696845:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b786fef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201184.697095:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1788201184.697100:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201184.697241:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b786fef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.697275:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786fe8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dfc expref: 28 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.697296:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b786fef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dfc expref: 27 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.697306:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:0.0:1788201184.697309:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201184.697321:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676fa00, rc 0) 00000100:00100000:0.0:1788201184.697399:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:10419:x1875064614064384:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 781us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201184.697408:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 65 00000100:00100000:3.0:1788201184.707917:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201184.708026:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614064768 00000100:00100000:2.0:1788201184.708038:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614064768 00000100:00100000:2.0:1788201184.708124:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:2.0:1788201184.708164:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:10419:x1875064614064768:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:2.0:1788201184.708591:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:10419:x1875064614064768:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 455us (687us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1788201184.708600:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:3.0:1788201184.712936:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201184.713058:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614064896 00000100:00100000:1.0:1788201184.713070:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614064896 00000100:00100000:1.0:1788201184.713206:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:1.0:1788201184.713219:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:10419:x1875064614064896:12345-192.168.203.14@tcp:103:lfs.0 00010000:00010000:1.0:1788201184.713238:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788201184.713269:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b786f7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2de0 expref: 28 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.713295:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786fda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2df5 expref: 27 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.713310:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b786e83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2da1 expref: 26 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201184.713321:0:6691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3c00) 00010000:00010000:1.0:1788201184.713335:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201184.713408:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+25:10419:x1875064614064896:12345-192.168.203.14@tcp:103:lfs.0 Request processed in 191us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201184.713416:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00010000:00010000:2.0:1788201184.715532:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201184.718801:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201184.719857:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614065024 00000100:00100000:0.0:1788201184.719872:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614065024 00000100:00100000:0.0:1788201184.719977:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 66 00000100:00100000:0.0:1788201184.719988:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+25:10419:x1875064614065024:12345-192.168.203.14@tcp:58:lfs.0 00010000:00010000:0.0:1788201184.720160:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786ff6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.720180:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786ff6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.720201:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786ff6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201184.721663:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201184.721910:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788201184.721995:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788201184.722123:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+25:10419:x1875064614065024:12345-192.168.203.14@tcp:58:lfs.0 Request processed in 2131us (3331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201184.724564:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 66 00000100:00100000:3.0:1788201184.749016:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201184.749128:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614065152 00000100:00100000:0.0:1788201184.749191:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614065152 00000100:00100000:0.0:1788201184.749267:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00100000:0.0:1788201184.749279:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+25:10421:x1875064614065152:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788201184.749301:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201184.749323:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786ffd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e03 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.752577:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787004 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.752592:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787004 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.752604:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787004 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.752622:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78700b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.752629:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78700b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.752635:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78700b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754013:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787012 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754027:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754036:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201184.754082:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788201184.754086:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201184.754106:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754130:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754166:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787004 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754173:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787004 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754179:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787004 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754186:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201184.754190:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787004 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754199:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787004 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754212:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:0.0:1788201184.754215:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201184.754220:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787004 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754226:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787004 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754245:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78700b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754251:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78700b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754263:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78700b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754269:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676e000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201184.754272:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78700b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754278:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78700b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754285:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b0002a80400) 00010000:00010000:0.0:1788201184.754288:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201184.754290:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78700b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754296:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78700b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754332:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b786ffd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e03 expref: 27 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754346:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787012 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e03 expref: 26 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201184.754354:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0002a80200) 00010000:00010000:0.0:1788201184.754356:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201184.754359:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676f600, rc 0) 00000100:00100000:0.0:1788201184.754430:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:10421:x1875064614065152:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 5153us (5428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201184.754450:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00100000:1.0:1788201185.040410:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0003ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622476416:0@lo:400:kworker.0 00000100:00100000:1.0:1788201185.040484:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201185.040538:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0003ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622476928:0@lo:400:kworker.0 00000100:00100000:1.0:1788201185.040566:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201185.040597:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201185.040603:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0003ee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622476288:0@lo:400:kworker.0 00000100:00100000:1.0:1788201185.040651:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201185.040675:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0003ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622476800:0@lo:400:kworker.0 00000100:00100000:1.0:1788201185.040696:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201185.040726:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0003ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622476544:0@lo:400:kworker.0 00000100:00100000:1.0:1788201185.040933:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201185.040954:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201185.040961:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0003ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622476672:0@lo:400:kworker.0 00000100:00100000:1.0:1788201185.040984:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201185.041015:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622476288 00000100:00100000:1.0:1788201185.041022:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622476288 00000100:00100000:1.0:1788201185.041065:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788201185.041074:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:3295:x1875064622476288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201185.041123:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:3295:x1875064622476288:12345-0@lo:400:kworker.0 Request processed in 50us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201185.041131:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788201185.041181:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622476416 00000100:00100000:1.0:1788201185.041185:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622476416 00000100:00100000:1.0:1788201185.041208:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622476800 00000100:00100000:1.0:1788201185.041211:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622476800 00000100:00100000:1.0:1788201185.041232:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622476544 00000100:00100000:1.0:1788201185.041235:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622476544 00000100:00100000:1.0:1788201185.041249:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788201185.041264:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622476416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201185.041617:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622476416:12345-0@lo:400:kworker.0 Request processed in 36us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201185.041633:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788201185.041648:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788201185.041655:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875064622476800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201185.041690:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875064622476800:12345-0@lo:400:kworker.0 Request processed in 36us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201185.041696:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788201185.041707:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788201185.041713:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622476544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201185.042086:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622476544:12345-0@lo:400:kworker.0 Request processed in 372us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201185.042094:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788201185.042114:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622476928 00000100:00100000:1.0:1788201185.042119:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622476928 00000100:00100000:1.0:1788201185.042162:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622476672 00000100:00100000:1.0:1788201185.042165:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622476672 00000100:00100000:1.0:1788201185.042197:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201185.042204:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3295:x1875064622476928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201185.042238:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3295:x1875064622476928:12345-0@lo:400:kworker.0 Request processed in 35us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201185.042244:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201185.042267:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201185.042281:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622476672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201185.043071:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201185.043087:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622477056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201185.043125:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201185.043198:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622477056 00000100:00100000:3.0:1788201185.043203:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622477056 00000100:00100000:3.0:1788201185.043232:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788201185.043239:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1875064622477056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201185.043286:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201185.043335:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1875064622477056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201185.043342:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788201185.043386:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622477056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201185.043427:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0003ee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622476288:0@lo:400:kworker.0 00000100:00100000:3.0:1788201185.043438:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0003ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622476800:0@lo:400:kworker.0 00000100:00100000:3.0:1788201185.043449:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0003ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622476416:0@lo:400:kworker.0 00000100:00100000:3.0:1788201185.043458:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0003ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622476928:0@lo:400:kworker.0 00000100:00080000:2.0:1788201185.048864:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201185.048873:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201185.048877:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201185.060927:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622476672:12345-0@lo:400:kworker.0 Request processed in 18644us (19932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201185.060953:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788201185.061060:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0003ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622476672:0@lo:400:kworker.0 00000100:00100000:3.0:1788201185.061087:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0003ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622476544:0@lo:400:kworker.0 00010000:00010000:0.0:1788201185.739668:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788201185.739857:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788201185.739862:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788201185.739917:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788201185.739924:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788201185.740044:0:11684:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0003ee6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875064622477184:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788201185.740171:0:11684:0:(client.c:2702:ptlrpc_set_wait()) set ffff9aff01b6b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201185.748519:0:11684:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0003ee6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875064622477184:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788201185.749933:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201185.750100:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614065280 00000100:00100000:1.0:1788201185.750109:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614065280 00000100:00100000:1.0:1788201185.750198:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:1.0:1788201185.750209:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:10432:x1875064614065280:12345-192.168.203.14@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788201185.750292:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:10432:x1875064614065280:12345-192.168.203.14@tcp:900:lhsmtool_posix.0 Request processed in 84us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201185.750301:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00080000:0.0:1788201185.750850:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201185.755068:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201185.755408:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614065408 00000100:00100000:1.0:1788201185.755418:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614065408 00000100:00100000:1.0:1788201185.755504:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 68 00000100:00100000:1.0:1788201185.755514:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:10432:x1875064614065408:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788201185.755560:0:5829:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788201185.755679:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:10432:x1875064614065408:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 166us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201185.755688:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 68 00000100:00100000:1.0:1788201185.759753:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201185.759902:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614065536 00000100:00100000:3.0:1788201185.759911:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614065536 00000100:00100000:3.0:1788201185.759973:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:3.0:1788201185.759984:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:10432:x1875064614065536:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788201185.760065:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787019 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760083:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787019 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760094:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787019 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760110:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787020 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760126:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787020 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760151:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787020 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760192:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b787027 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760201:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b787027 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760208:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b787027 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201185.760534:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788201185.760539:0:5828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201185.760553:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b787027 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760727:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787019 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760732:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787019 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760737:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787019 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760741:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201185.760744:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787019 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760748:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787019 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760756:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b0011cb3e00) 00010000:00010000:3.0:1788201185.760764:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201185.760768:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787019 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760772:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787019 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760786:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787020 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760791:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787020 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760797:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787020 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760802:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201185.760805:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787020 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760810:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787020 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760818:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9b00109a1a00) 00010000:00010000:3.0:1788201185.760833:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201185.760837:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787020 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760843:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787020 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760858:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b787027 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760871:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b787027 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760995:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b787027 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.760999:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201185.761001:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b787027 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.761005:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b787027 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.761011:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0002a80200) 00010000:00010000:3.0:1788201185.761012:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201185.761015:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b787027 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.761018:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b787027 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201185.761092:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:10432:x1875064614065536:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 Request processed in 1108us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201185.761100:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:2.0:1788201185.766259:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201185.767298:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614065792 00000100:00100000:3.0:1788201185.767310:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614065792 00000100:00100000:3.0:1788201185.767360:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 70 00000100:00100000:3.0:1788201185.767370:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:10432:x1875064614065792:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201185.767391:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201185.767416:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b78702e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e0a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.767510:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b787035 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.767525:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b787035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.767536:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b787035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201185.767547:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788201185.767914:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b787035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.767923:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b787035 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.767930:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b787035 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.767936:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201185.767939:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b787035 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.767947:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b787035 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.767959:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0002a80200) 00010000:00010000:3.0:1788201185.767962:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201185.767967:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b787035 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.767981:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b787035 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.768023:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b78702e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e0a expref: 28 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.768034:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b0011cb3e00) 00010000:00010000:3.0:1788201185.768037:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201185.768040:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b78702e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e0a expref: 28 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.768050:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c7400, rc 0) 00000100:00100000:3.0:1788201185.768113:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:10432:x1875064614065792:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 745us (1861us total) trans 4294967352 rc 301/301 00000100:00100000:3.0:1788201185.768121:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 70 00000100:00100000:2.0:1788201185.774920:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201185.776447:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614065920 00000100:00100000:3.0:1788201185.776464:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614065920 00000100:00100000:3.0:1788201185.776529:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 71 00000100:00100000:3.0:1788201185.776538:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:10432:x1875064614065920:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788201185.776576:0:9471:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788201185.776723:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:10432:x1875064614065920:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 177us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201185.776733:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 71 00000100:00100000:2.0:1788201185.779932:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201185.780434:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614066176 00000100:00100000:3.0:1788201185.780445:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614066176 00000100:00100000:3.0:1788201185.780502:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 72 00000100:00100000:3.0:1788201185.780520:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:10432:x1875064614066176:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201185.780543:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201185.780546:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788201185.780574:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b786fef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2dfc expref: 27 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.780606:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:3.0:1788201185.780616:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201185.780630:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787043 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e11 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201185.781314:0:5827:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788201185.781540:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b78704a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.781554:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b78704a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.781564:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b78704a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.781620:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787043 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e11 expref: 29 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.781635:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b78704a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e11 expref: 28 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.781643:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b00109a1700) 00010000:00010000:3.0:1788201185.781646:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201185.781653:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c6000, rc 0) 00000100:00100000:3.0:1788201185.781719:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:10432:x1875064614066176:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 1200us (1795us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788201185.781727:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 72 00000100:00100000:2.0:1788201185.797687:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201185.797757:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614066432 00000100:00100000:1.0:1788201185.797765:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614066432 00000100:00100000:1.0:1788201185.797829:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 73 00000100:00100000:1.0:1788201185.797839:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:10432:x1875064614066432:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788201185.797894:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201185.797920:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b78704a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e11 expref: 28 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.797947:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b00109a1700) 00010000:00010000:1.0:1788201185.797957:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201185.797979:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787058 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.797991:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787058 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.798001:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787058 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.798015:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b78705f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7171ee35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.798022:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b78705f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7171ee35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.798028:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b78705f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7171ee35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.798479:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787058 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.798487:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787058 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.798494:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787058 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.798500:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201185.798504:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787058 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.798517:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787058 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.798528:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:1.0:1788201185.798531:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201185.798535:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787058 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.798541:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787058 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.798551:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b78705f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7171ee35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.798557:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b78705f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7171ee35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.798563:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b78705f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7171ee35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.798568:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201185.798571:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b78705f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7171ee35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.798576:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b78705f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7171ee35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.798584:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7171ee35 (ffff9b00033b2100) 00010000:00010000:1.0:1788201185.798586:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201185.798589:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b78705f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7171ee35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.798602:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b78705f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7171ee35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201185.798727:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:10432:x1875064614066432:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 889us (1049us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201185.798735:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 73 00000100:00100000:3.0:1788201185.807904:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201185.807942:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614066560 00000100:00100000:3.0:1788201185.807951:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614066560 00000100:00100000:3.0:1788201185.807999:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 74 00000100:00100000:3.0:1788201185.808007:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:10432:x1875064614066560:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201185.808027:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201185.808048:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787066 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e18 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201185.808058:0:11998:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788201185.808062:0:11998:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:3.0:1788201185.808083:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b78706d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201185.808094:0:11998:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00010000:00010000:3.0:1788201185.808097:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b78706d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201185.808101:0:11998:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788201185.808107:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b78706d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.808588:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787066 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e18 expref: 29 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.808605:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b78706d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e18 expref: 28 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.808677:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b00109a1a00) 00010000:00010000:3.0:1788201185.808686:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788201185.808690:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c7400, rc 0) 00000100:00100000:3.0:1788201185.808745:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:10432:x1875064614066560:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 738us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201185.808753:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 74 00000100:00100000:2.0:1788201185.813925:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201185.813991:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614066816 00000100:00100000:3.0:1788201185.815948:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614066816 00000100:00100000:3.0:1788201185.816005:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 75 00000100:00100000:3.0:1788201185.816015:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:10432:x1875064614066816:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788201185.816103:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787074 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.816121:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.816153:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201185.816450:0:9471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788201185.816459:0:9471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 264941324970ns, next at 265941322726ns, rc = 0 00000004:00010000:3.0:1788201185.816883:0:9471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8c0346f reply state 00000000f31ec435 transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201185.816894:0:9471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201185.816995:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+30:10432:x1875064614066816:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 980us (3075us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788201185.817002:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 75 00010000:00010000:3.0:1788201185.824591:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.824619:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787074 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.824626:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787074 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.824632:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201185.824637:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787074 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.824644:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787074 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.824660:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b00109a1a00) 00010000:00010000:3.0:1788201185.824663:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201185.824669:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787074 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.824675:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787074 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201185.824911:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201185.825003:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614066944 00000100:00100000:1.0:1788201185.825012:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614066944 00000100:00100000:1.0:1788201185.825063:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 76 00000100:00100000:1.0:1788201185.825073:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+29:10432:x1875064614066944:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201185.825097:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201185.825115:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b78707b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e1f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.825195:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b78707b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e1f expref: 30 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.825209:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b78707b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e1f expref: 30 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.825228:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b00109a1a00) 00010000:00010000:1.0:1788201185.825231:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201185.825233:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680e00, rc 0) 00000100:00100000:1.0:1788201185.825288:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+30:10432:x1875064614066944:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 216us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201185.825295:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 76 00000100:00100000:2.0:1788201185.836167:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201185.836348:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614067072 00000100:00100000:3.0:1788201185.836358:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614067072 00000100:00100000:3.0:1788201185.836406:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:3.0:1788201185.836415:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875064614067072:12345-192.168.203.14@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788201185.836444:0:6678:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:3.0:1788201185.836472:0:6678:0:(genops.c:1406:class_connect()) connect: client aa6eef1a-3f03-469a-ac4c-2a406b6709bc, cookie 0x72011f792b787082 00002000:00100000:3.0:1788201185.836483:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aa6eef1a-3f03-469a-ac4c-2a406b6709bc/ffff9b0003202800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788201185.836514:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788201185.836715:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788201185.836742:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9b0003201000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201185.836810:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2347:x1875064614067072:12345-192.168.203.14@tcp:8:lhsmtool_posix.0 Request processed in 395us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201185.836818:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:0.0:1788201185.857339:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201185.858313:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614067200 00000100:00100000:3.0:1788201185.858323:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614067200 00000100:00100000:3.0:1788201185.858377:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:3.0:1788201185.858386:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:0:x1875064614067200:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788201185.858620:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788201185.906057:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1788201185.906070:0:6702:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa6eef1a-3f03-469a-ac4c-2a406b6709bc 00000100:00100000:1.0:1788201185.906550:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:0:x1875064614067200:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 48159us (49214us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788201185.906561:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:1.0:1788201185.910512:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201185.910594:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614067456 00000100:00100000:3.0:1788201185.910603:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614067456 00000100:00100000:3.0:1788201185.910697:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:3.0:1788201185.910707:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+30:10432:x1875064614067456:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788201185.910956:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:10432:x1875064614067456:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 247us (450us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788201185.910965:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:3.0:1788201185.915021:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201185.915179:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614067712 00000100:00100000:1.0:1788201185.915189:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614067712 00000100:00100000:1.0:1788201185.915250:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 77 00000100:00100000:1.0:1788201185.915260:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:10432:x1875064614067712:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788201185.915372:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:10432:x1875064614067712:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 113us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201185.915380:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 77 00000100:00100000:1.0:1788201185.921764:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201185.923730:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614067840 00000100:00100000:3.0:1788201185.923742:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614067840 00000100:00100000:3.0:1788201185.923803:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 78 00000100:00100000:3.0:1788201185.923814:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:10432:x1875064614067840:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201185.923844:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201185.923864:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787089 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e26 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.923945:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b787090 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.923959:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b787090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.923971:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b787090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201185.924006:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201185.924025:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b787090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.924052:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787089 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e26 expref: 33 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.924067:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b787090 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e26 expref: 32 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.924075:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b00109a1a00) 00010000:00010000:3.0:1788201185.924078:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788201185.924082:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c6a00, rc 0) 00000100:00100000:3.0:1788201185.924295:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:10432:x1875064614067840:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 482us (2537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201185.924303:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 78 00000100:00100000:1.0:1788201185.928068:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201185.928316:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614067968 00000100:00100000:2.0:1788201185.928324:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614067968 00000100:00100000:2.0:1788201185.928390:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:2.0:1788201185.928398:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2349:x1875064614067968:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201185.928415:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201185.928433:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2e4bd2b/0x72011f792b787097 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e2d expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201185.928455:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95c8e1, blocks: 0x1 00010000:00010000:2.0:1788201185.928473:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=265s v=(0 0) 00010000:00010000:2.0:1788201185.928478:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201185.928487:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e4bd2b/0x72011f792b787097 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e2d expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201185.928507:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f2e4bd2b/0x72011f792b787097 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e2d expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201185.928520:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1800, rc 0) 00000100:00100000:2.0:1788201185.928576:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614067968:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 177us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201185.928583:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:0.0:1788201185.931540:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201185.931669:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614068224 00000100:00100000:2.0:1788201185.931683:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614068224 00000100:00100000:2.0:1788201185.931740:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 79 00000100:00100000:2.0:1788201185.931750:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:10432:x1875064614068224:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788201185.932084:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:10432:x1875064614068224:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 334us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201185.932091:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 79 00000100:00100000:0.0:1788201185.941781:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201185.941818:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614068352 00000100:00100000:0.0:1788201185.941839:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614068352 00000100:00100000:0.0:1788201185.941888:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:0.0:1788201185.941898:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:10432:x1875064614068352:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201185.941917:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201185.941935:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e59672f5/0x72011f792b78709e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e34 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201185.941967:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2e4bd2b/0x72011f792b787097 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e2d expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201185.941977:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201185.941982:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201185.941987:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e59672f5/0x72011f792b78709e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e34 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201185.942027:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f2e4bd2b/0x72011f792b787097 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e2d expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201185.942041:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f2e4bd2b/0x72011f792b787097 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e2d expref: 7 pid: 6678 timeout: 365 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201185.942055:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875064622477312:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788201185.942167:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff9aff01b6ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201185.953594:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201185.953769:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875064622477312:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788201185.953883:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e59672f5/0x72011f792b78709e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e34 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201185.953922:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676e400, rc 0) 00000100:00100000:1.0:1788201185.953972:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614068480 00000100:00100000:1.0:1788201185.953979:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614068480 00000100:00100000:3.0:1788201185.953983:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:10432:x1875064614068352:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 12086us (12209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201185.953991:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 28 00010000:00010000:1.0:1788201185.954015:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e4bd2b/0x72011f792b787097 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e2d expref: 7 pid: 6678 timeout: 365 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201185.954051:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:1.0:1788201185.954061:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006798850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2349:x1875064614068480:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201185.954074:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201185.954097:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f2e4bd2b/0x72011f792b787097 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e2d expref: 7 pid: 6678 timeout: 365 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.954110:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f2e4bd2b/0x72011f792b787097 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e2d expref: 7 pid: 6678 timeout: 365 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.954179:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2e4bd2b/0x72011f792b787097 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e2d expref: 7 pid: 6678 timeout: 365 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.954207:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201185.954212:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201185.954220:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e59672f5/0x72011f792b78709e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e34 expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.954231:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e59672f5/0x72011f792b78709e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e34 expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201185.954263:0:5813:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e59672f5/0x72011f792b78709e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e34 expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201185.954276:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5813:1875064622477440:192.168.203.14@tcp:105: 00000100:00100000:1.0:1788201185.954323:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00104f8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201185.959327:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5813:1875064622477440:192.168.203.14@tcp:105: 00010000:00010000:3.0:1788201185.959351:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201185.959406:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006798850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614068480:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 5346us (5822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201185.959419:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:0.0:1788201185.960466:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201185.960519:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614068608 00000100:00100000:2.0:1788201185.960528:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614068608 00002000:00100000:2.0:1788201185.960569:0:6683:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b003f378380 x1875064614068608/t0(0) o4->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:306/0 lens 504/0 e 0 to 0 dl 1788201196 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201185.960581:0:6683:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b003f378380 with x1875064614068608 ext(0->8) 00002000:00010000:2.0:1788201185.960586:0:6683:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b003f378380 00000100:00100000:2.0:1788201185.960619:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:2.0:1788201185.960628:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2351:x1875064614068608:12345-192.168.203.14@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788201185.961243:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2351:x1875064614068608:12345-192.168.203.14@tcp:4:lhsmtool_posix.0 Request processed in 614us (781us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788201185.961252:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00002000:00100000:2.0:1788201185.961260:0:6683:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b003f378380 x1875064614068608/t4294967302(0) o4->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:306/0 lens 504/448 e 0 to 0 dl 1788201196 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201185.961269:0:6683:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b003f378380 with x1875064614068608 ext(0->8) 00002000:00010000:2.0:1788201185.961273:0:6683:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b003f378380 00000100:00100000:0.0:1788201185.968481:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201185.968954:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614068736 00000100:00100000:1.0:1788201185.968964:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614068736 00000100:00100000:1.0:1788201185.969086:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 80 00000100:00100000:1.0:1788201185.969097:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:10432:x1875064614068736:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788201185.991904:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000001:00080000:2.0:1788201185.991936:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000020:00080000:2.0:1788201185.991952:0:5849:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:2.0:1788201185.991970:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000004:00080000:2.0:1788201185.991994:0:5849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:2.0:1788201185.992258:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622477568:0@lo:2:osp-syn-0-0.0 00000020:00080000:0.0:1788201185.992299:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788201185.992313:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788201185.992336:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201185.992379:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622477568 00000100:00100000:1.0:1788201185.992386:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622477568 00000100:00100000:1.0:1788201185.992432:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201185.992443:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622477568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788201185.992609:0:7765:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788201185.992613:0:7765:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788201185 00002000:00010000:1.0:1788201185.992615:0:7765:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788201185.992617:0:7765:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788201185 -> 1788201185 00002000:00010000:1.0:1788201185.992619:0:7765:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788201185.992648:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:10432:x1875064614068736:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 Request processed in 23551us (24172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201185.992658:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 80 00000100:00100000:1.0:1788201185.992886:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3293:x1875064622477568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 444us (549us total) trans 4294967303 rc 0/0 00000004:00080000:3.0:1788201185.992894:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b003f37dc00/2, rc 0, transno 4294967303 00000100:00100000:1.0:1788201185.992894:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788201185.992900:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622477568:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788201185.995961:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201185.996226:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614068864 00000100:00100000:0.0:1788201185.996234:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614068864 00000100:00100000:0.0:1788201185.996287:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00100000:0.0:1788201185.996298:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2349:x1875064614068864:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788201186.019641:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1788201186.019669:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1788201186.019817:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614068864:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 Request processed in 23515us (23859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201186.019837:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00100000:0.0:1788201186.024122:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201186.024227:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614069120 00000100:00100000:1.0:1788201186.024236:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614069120 00000100:00100000:1.0:1788201186.024290:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 81 00000100:00100000:1.0:1788201186.024299:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:10432:x1875064614069120:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788201186.024348:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201186.024373:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b787090 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e26 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.024393:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b00109a1a00) 00010000:00010000:1.0:1788201186.024397:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201186.024424:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.024438:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.024447:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201186.024674:0:5828:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b054924 reply state 00000000f4fcc3a4 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201186.024710:0:5828:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201186.024799:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:10432:x1875064614069120:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 500us (685us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1788201186.024806:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 81 00000100:00100000:2.0:1788201186.031170:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00010000:00010000:0.0:1788201186.031293:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.031306:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.031329:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.031336:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201186.031340:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.031349:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.031364:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b00109a1a00) 00010000:00010000:0.0:1788201186.031367:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201186.031371:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.031378:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201186.032255:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614069248 00000100:00100000:3.0:1788201186.032265:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614069248 00000100:00100000:3.0:1788201186.032364:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 31 00000100:00100000:3.0:1788201186.032375:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614069248:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788201186.032614:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788201186.032617:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788201185 -> 1788201184 00002000:00010000:3.0:1788201186.032620:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788201182 00002000:00010000:3.0:1788201186.032623:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788201185 -> 1788201184 00002000:00010000:3.0:1788201186.032626:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788201186.032689:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2349:x1875064614069248:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 315us (1552us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788201186.032720:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 31 00000100:00100000:3.0:1788201186.035111:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201186.035228:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614069504 00000100:00100000:1.0:1788201186.035236:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614069504 00000100:00100000:1.0:1788201186.035291:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 82 00000100:00100000:1.0:1788201186.035299:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:10432:x1875064614069504:12345-192.168.203.14@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788201186.035356:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.035379:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b78706d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e18 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.035385:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870ac lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.035410:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b78706d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e18 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.035419:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b78706d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e18 expref: 13 pid: 5827 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201186.035430:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5827:1875064622477696:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201186.035508:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00104f8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201186.038712:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201186.038789:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614069632 00000100:00100000:2.0:1788201186.038797:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614069632 00010000:00010000:2.0:1788201186.038843:0:6691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b78706d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e18 expref: 14 pid: 5827 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201186.038883:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:2.0:1788201186.038894:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:2348:x1875064614069632:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201186.038907:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201186.038914:0:6691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b78706d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e18 expref: 14 pid: 5827 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201186.038923:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5827:1875064622477696:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788201186.038930:0:6691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b78706d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e18 expref: 14 pid: 5827 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201186.038952:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b78706d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e18 expref: 14 pid: 5827 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.038965:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201186.038969:0:6691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b00109a1a00) 00010000:00010000:2.0:1788201186.038980:0:6691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201186.038990:0:6691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201186.038997:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870ac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.039033:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201186.039034:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201186.039044:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.039072:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.039079:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.039086:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201186.039089:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:2348:x1875064614069632:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 195us (384us total) trans 0 rc 0/0 00010000:00010000:1.0:1788201186.039098:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681800 already unused, calling callback (ffffffffc20cb4f0) 00000100:00100000:2.0:1788201186.039103:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 43 00010000:00010000:1.0:1788201186.039105:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.039115:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.039126:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b00109a1a00) 00010000:00010000:1.0:1788201186.039129:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788201186.039574:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.039584:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201186.039806:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+12:10432:x1875064614069504:12345-192.168.203.14@tcp:55:lhsmtool_posix.0 Request processed in 4506us (4702us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788201186.039815:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 82 00000100:00100000:0.0:1788201186.042276:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201186.042349:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614069760 00000100:00100000:3.0:1788201186.042357:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614069760 00000100:00100000:3.0:1788201186.042404:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:3.0:1788201186.042414:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2348:x1875064614069760:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788201186.042452:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ab84f25/0x72011f792b7870b3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.042472:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e59672f5/0x72011f792b78709e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e34 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.042481:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201186.042484:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201186.042489:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ab84f25/0x72011f792b7870b3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.042520:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e59672f5/0x72011f792b78709e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e34 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.042534:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e59672f5/0x72011f792b78709e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e34 expref: 7 pid: 6677 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201186.042548:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875064622477824:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201186.042619:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00063150c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201186.044913:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875064622477824:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788201186.044923:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00010000:00010000:3.0:1788201186.044945:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ab84f25/0x72011f792b7870b3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201186.045051:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614069888 00000100:00100000:2.0:1788201186.045058:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614069888 00010000:00010000:2.0:1788201186.045099:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e59672f5/0x72011f792b78709e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e34 expref: 8 pid: 6677 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201186.045167:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:3.0:1788201186.045179:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2349:x1875064614069888:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201186.045193:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201186.045213:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e59672f5/0x72011f792b78709e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e34 expref: 8 pid: 6677 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.045226:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e59672f5/0x72011f792b78709e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e34 expref: 8 pid: 6677 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.045248:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e59672f5/0x72011f792b78709e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e34 expref: 8 pid: 6677 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.045263:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201186.045267:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201186.045273:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ab84f25/0x72011f792b7870b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.045282:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ab84f25/0x72011f792b7870b3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.045312:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201186.045320:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ab84f25/0x72011f792b7870b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.045329:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ab84f25/0x72011f792b7870b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.045349:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ab84f25/0x72011f792b7870b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.045379:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ab84f25/0x72011f792b7870b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.045387:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ab84f25/0x72011f792b7870b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.045392:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7000 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201186.045395:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ab84f25/0x72011f792b7870b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.045400:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ab84f25/0x72011f792b7870b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.045409:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ab84f25/0x72011f792b7870b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.045413:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ab84f25/0x72011f792b7870b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201186.045752:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2348:x1875064614069760:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 Request processed in 3337us (3481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201186.045761:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:2.0:1788201186.045854:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614069888:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 677us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201186.045861:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:2.0:1788201186.049362:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201186.049448:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614070144 00000100:00100000:3.0:1788201186.049464:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614070144 00000100:00100000:3.0:1788201186.049517:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 83 00000100:00100000:3.0:1788201186.049526:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+12:10432:x1875064614070144:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788201186.049596:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7870ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.049610:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7870ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.049620:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7870ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.049835:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b7870c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.049847:0:9471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b78707b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e1f expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.049855:0:9471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b7870c1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.049887:0:9471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b78707b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e1f expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.049901:0:9471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b78707b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e1f expref: 13 pid: 5827 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201186.049916:0:9471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c06680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9471:1875064622477952:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201186.050027:0:9471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00063150c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201186.054678:0:9471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c06680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9471:1875064622477952:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788201186.054712:0:9471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b7870c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201186.056245:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201186.056367:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614070272 00000100:00100000:3.0:1788201186.056390:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614070272 00010000:00010000:3.0:1788201186.056426:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b78707b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e1f expref: 14 pid: 5827 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201186.056518:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:2.0:1788201186.056530:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:2349:x1875064614070272:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201186.056551:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201186.056558:0:6691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b78707b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e1f expref: 14 pid: 5827 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201186.056572:0:6691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b78707b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e1f expref: 14 pid: 5827 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201186.056601:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b78707b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e1f expref: 14 pid: 5827 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201186.056618:0:6691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b00109a1a00) 00010000:00010000:2.0:1788201186.056623:0:6691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b7870c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201186.056632:0:6691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b7870c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201186.056639:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b7870c1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201186.056667:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201186.056690:0:9471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b7870c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.056697:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b7870c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201186.056764:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:2349:x1875064614070272:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 227us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201186.056772:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 45 00000001:00080000:3.0:1788201186.056947:0:9471:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788201186.057192:0:9471:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1788201186.057321:0:9471:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788201186.057403:0:9471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f378e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9471:1875064622478080:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788201186.057462:0:9471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201186.057527:0:9471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9aff01b6ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201186.057625:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622478080 00000100:00100000:2.0:1788201186.057631:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622478080 00000100:00100000:2.0:1788201186.057726:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201186.057737:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9471:x1875064622478080:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788201186.057816:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9471:x1875064622478080:12345-0@lo:1000:mdt00_003.0 Request processed in 82us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201186.057844:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201186.057907:0:9471:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788201186.057912:0:9471:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b003f37dc00, transno 4294967303 00000100:00100000:0.0:1788201186.057934:0:9471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f378e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9471:1875064622478080:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788201186.058374:0:9471:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1788201186.058430:0:9471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f378e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9471:1875064622478208:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788201186.058479:0:9471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201186.058508:0:9471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9aff01b6b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201186.058528:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622478208 00000100:00100000:2.0:1788201186.058533:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622478208 00000100:00100000:2.0:1788201186.058557:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201186.058563:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9471:x1875064622478208:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788201186.058898:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9471:x1875064622478208:12345-0@lo:1000:mdt00_003.0 Request processed in 334us (417us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788201186.058907:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788201186.058952:0:9471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f378e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9471:1875064622478208:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788201186.058981:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b7870c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.058989:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b7870c1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.058997:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b7870c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.059003:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201186.059007:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b7870c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.059014:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b7870c1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.059029:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b00109a1a00) 00010000:00010000:0.0:1788201186.059032:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201186.059036:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b7870c1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.059047:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b7870c1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201186.059319:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622478336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201186.059376:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201186.059735:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622478336 00000100:00100000:2.0:1788201186.059741:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622478336 00000100:00100000:2.0:1788201186.059777:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788201186.059785:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1875064622478336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201186.059800:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788201186.059862:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1875064622478336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201186.059868:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:0.0:1788201186.059868:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786ff6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.059876:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786ff6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.059882:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786ff6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.059887:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676ee00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201186.059891:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786ff6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.059897:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786ff6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.059907:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0002a80200) 00010000:00010000:0.0:1788201186.059910:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201186.059913:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786ff6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.059919:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b786ff6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.059948:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7870c8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.059961:0:9471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787012 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e03 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.059979:0:9471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7870c8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.060003:0:9471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787012 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e03 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.060011:0:9471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787012 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e03 expref: 16 pid: 5827 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201186.060020:0:9471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f378000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9471:1875064622478464:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201186.060117:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622478336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201186.060455:0:9471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9aff01b6b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201186.062573:0:9471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f378000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9471:1875064622478464:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788201186.062575:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00010000:00010000:0.0:1788201186.062595:0:9471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7870c8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201186.062776:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614070400 00000100:00100000:3.0:1788201186.062783:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614070400 00010000:00010000:3.0:1788201186.062813:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787012 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e03 expref: 17 pid: 5827 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201186.062860:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:3.0:1788201186.062870:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+17:2348:x1875064614070400:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201186.062883:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201186.062890:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787012 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e03 expref: 17 pid: 5827 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.062902:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787012 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e03 expref: 17 pid: 5827 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.062926:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787012 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e03 expref: 17 pid: 5827 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.062952:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0002a80200) 00010000:00010000:3.0:1788201186.062955:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7870c8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.062962:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7870c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.062967:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7870c8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201186.062990:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201186.063003:0:9471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7870c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.063010:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7870c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.063021:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7870c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.063027:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7870c8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.063033:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7870c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201186.063035:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+16:2348:x1875064614070400:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 167us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201186.063042:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 46 00010000:00010000:0.0:1788201186.063045:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201186.063049:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7870c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.063056:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7870c8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.063065:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0002a80200) 00010000:00010000:0.0:1788201186.063076:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201186.063081:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7870c8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.063087:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7870c8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.063098:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7870ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.063104:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7870ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.063110:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7870ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.063115:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201186.063118:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7870ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.063123:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7870ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.063861:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0002a80200) 00010000:00010000:0.0:1788201186.063864:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788201186.063868:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7870ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.063875:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7870ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201186.064099:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:10432:x1875064614070144:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 14572us (14744us total) trans 4294967361 rc 0/0 00000100:00100000:0.0:1788201186.064108:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 83 00000020:00080000:0.0:1788201186.064112:0:9471:0:(tgt_main.c:807:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788201186.064305:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788201186.064310:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788201186.064334:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788201186.064339:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788201186.066412:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201186.066460:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614070656 00000100:00100000:0.0:1788201186.066470:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614070656 00000100:00100000:0.0:1788201186.066525:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:0.0:1788201186.066535:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:10432:x1875064614070656:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788201186.067195:0:5830:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788201186.067302:0:5830:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:0.0:1788201186.067338:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b7870cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.067350:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b7870cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.067357:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b7870cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.067363:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b7870cf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.067375:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b7870cf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.067379:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b7870cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201186.067395:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201186.067428:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201186.067436:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b7870cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.067443:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676ec00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201186.067446:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b7870cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.067464:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b7870cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.067481:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b0002a80400) 00010000:00010000:1.0:1788201186.067484:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:0.0:1788201186.067484:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+17:10432:x1875064614070656:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 949us (1076us total) trans 4294967363 rc 0/0 00010000:00010000:1.0:1788201186.067488:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b7870cf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201186.067491:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 20 00000020:00080000:0.0:1788201186.067495:0:5830:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788201186.067497:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b7870cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201186.067513:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201186.067515:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201186.067517:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201186.763320:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788201187.084521:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788201187.084533:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788201187.084566:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788201187.084573:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788201187.612512:0:12051:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788201187.612519:0:12051:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788201187.612541:0:12051:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788201187.612551:0:12051:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1788201187.650267:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:0.0:1788201187.650285:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1788201187.650295:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1788201187.743205:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201187.743482:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614070912 00000100:00100000:1.0:1788201187.743492:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614070912 00000100:00100000:1.0:1788201187.743574:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 84 00000100:00100000:1.0:1788201187.743585:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+17:10451:x1875064614070912:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788201187.743617:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201187.743639:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b7870d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e3b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.743923:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b7870dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.743939:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b7870dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.743952:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b7870dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201187.743964:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1788201187.744162:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b7870d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e3b expref: 20 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.744182:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b7870dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e3b expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.744191:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:1.0:1788201187.744194:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788201187.744198:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681600, rc 0) 00000100:00100000:1.0:1788201187.744256:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:10451:x1875064614070912:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 673us (1061us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788201187.744274:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 84 00000100:00080000:3.0:1788201187.744394:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201187.748231:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201187.748452:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614071040 00000100:00100000:1.0:1788201187.748462:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614071040 00000100:00100000:1.0:1788201187.748519:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 85 00000100:00100000:1.0:1788201187.748531:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:10451:x1875064614071040:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:1.0:1788201187.748605:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.748623:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.748634:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.748651:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7870f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.748658:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7870f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.748664:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7870f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.748983:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.748993:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.748999:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201187.749048:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749060:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749066:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749072:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749078:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201187.749083:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749089:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749102:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:1.0:1788201187.749105:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201187.749109:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749116:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7870eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749127:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7870f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749165:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7870f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749177:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7870f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749182:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201187.749185:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7870f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749191:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7870f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749199:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b00033b2100) 00010000:00010000:1.0:1788201187.749201:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201187.749204:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7870f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749209:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7870f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749226:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749231:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749237:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749242:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201187.749245:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749260:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749269:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b00033b2900) 00010000:00010000:1.0:1788201187.749271:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201187.749275:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.749280:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7870f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201187.750974:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:10451:x1875064614071040:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 2435us (2740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201187.750989:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 85 00010000:00010000:2.0:1788201187.788506:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201187.834493:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201187.834784:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614071296 00000100:00100000:2.0:1788201187.834794:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614071296 00000100:00100000:2.0:1788201187.835071:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 86 00000100:00100000:2.0:1788201187.835084:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:10454:x1875064614071296:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788201187.835104:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201187.835124:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1000/0x72011f792b787100 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e42 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.835225:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787107 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.835238:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787107 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.835250:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787107 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.835266:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78710e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.835273:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78710e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.835280:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78710e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837086:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787115 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837102:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787115 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837112:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787115 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201187.837122:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788201187.837233:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787107 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837241:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787107 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837254:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787107 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837260:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201187.837264:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787107 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837272:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787107 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837284:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:2.0:1788201187.837287:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201187.837292:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787107 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837299:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787107 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837313:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78710e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837319:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78710e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837325:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78710e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837329:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201187.837332:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78710e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837349:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78710e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837358:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b0011cb3100) 00010000:00010000:2.0:1788201187.837360:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201187.837363:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78710e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837369:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78710e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837416:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1000/0x72011f792b787100 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e42 expref: 22 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837431:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787115 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e42 expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.837438:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3d00) 00010000:00010000:2.0:1788201187.837440:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201187.837442:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0200, rc 0) 00000100:00100000:2.0:1788201187.838181:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:10454:x1875064614071296:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 3097us (3693us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788201187.838191:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 86 00000100:00100000:0.0:1788201187.841261:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201187.842612:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614071424 00000100:00100000:1.0:1788201187.842624:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614071424 00000100:00100000:1.0:1788201187.842733:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 87 00000100:00100000:1.0:1788201187.842744:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:10454:x1875064614071424:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:1.0:1788201187.842965:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787123 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.842983:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787123 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.842994:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787123 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.843022:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787123 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.843036:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787123 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.843042:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787123 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.843048:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201187.843052:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787123 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.843060:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787123 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.843072:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3d00) 00010000:00010000:1.0:1788201187.843074:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201187.843079:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787123 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.843084:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787123 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201187.843182:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:10454:x1875064614071424:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 439us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201187.843191:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 87 00000100:00100000:2.0:1788201187.855578:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201187.855624:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614071680 00000100:00100000:2.0:1788201187.855633:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614071680 00000100:00100000:2.0:1788201187.855693:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:2.0:1788201187.857393:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002289cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:10454:x1875064614071680:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:2.0:1788201187.857636:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002289cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:10454:x1875064614071680:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 1934us (2069us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788201187.857647:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:2.0:1788201187.894184:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201187.894262:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614071936 00000100:00100000:1.0:1788201187.894271:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614071936 00000100:00100000:1.0:1788201187.894328:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 88 00000100:00100000:1.0:1788201187.894339:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:9974:x1875064614071936:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788201187.894363:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201187.894396:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78712a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e49 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.894507:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787131 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.894524:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787115 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e42 expref: 23 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.894533:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787131 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.894566:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787115 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e42 expref: 23 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.894579:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787115 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e42 expref: 23 pid: 5829 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201187.894592:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5829:1875064622478592:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201187.894820:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00104f86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201187.899453:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201187.899593:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5829:1875064622478592:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201187.899621:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787131 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201187.899922:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614072064 00000100:00100000:3.0:1788201187.899937:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614072064 00010000:00010000:3.0:1788201187.900013:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787115 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e42 expref: 24 pid: 5829 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201187.900061:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 47 00000100:00100000:3.0:1788201187.900072:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+24:2349:x1875064614072064:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201187.900091:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201187.900100:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787115 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e42 expref: 24 pid: 5829 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201187.900114:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787115 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e42 expref: 24 pid: 5829 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201187.901463:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787115 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e42 expref: 24 pid: 5829 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201187.901659:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3d00) 00010000:00010000:3.0:1788201187.901667:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787131 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201187.901680:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787131 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201187.901688:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787131 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201187.901943:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201187.902027:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+23:2349:x1875064614072064:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 1951us (2576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201187.902038:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 47 00010000:00010000:1.0:1788201187.902200:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787131 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.902211:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787131 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201187.902249:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788201187.902415:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78712a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e49 expref: 24 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.902436:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787131 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e49 expref: 23 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.902444:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3d00) 00010000:00010000:1.0:1788201187.902447:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788201187.902449:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680e00, rc 0) 00000100:00100000:1.0:1788201187.902488:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+23:9974:x1875064614071936:12345-192.168.203.14@tcp:101:bash.0 Request processed in 8152us (8314us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1788201187.902495:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 88 00000100:00100000:2.0:1788201187.910312:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201187.911267:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614072320 00000100:00100000:0.0:1788201187.911277:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614072320 00000100:00100000:0.0:1788201187.911336:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 89 00000100:00100000:0.0:1788201187.911346:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+23:9974:x1875064614072320:12345-192.168.203.14@tcp:36:bash.0 00010000:00010000:0.0:1788201187.911609:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78713f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201187.911625:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78713f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201187.911636:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78713f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788201187.911688:0:5828:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:0.0:1788201187.911727:0:5828:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6d0fd4c reply state 000000008837bc4d transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78713f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201187.911736:0:5828:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788201187.911782:0:5828:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:0.0:1788201187.911903:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:9974:x1875064614072320:12345-192.168.203.14@tcp:36:bash.0 Request processed in 558us (1599us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1788201187.911910:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 89 00000020:00080000:0.0:1788201187.911915:0:5828:0:(tgt_main.c:807:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788201187.916562:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78713f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201187.916580:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78713f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201187.916605:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78713f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201187.916612:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676e000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201187.916616:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78713f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201187.916624:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78713f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201187.916640:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3d00) 00010000:00010000:3.0:1788201187.916643:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201187.916647:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78713f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201187.916654:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b78713f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201187.917702:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201187.918592:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614072448 00000100:00100000:0.0:1788201187.918603:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614072448 00000100:00100000:0.0:1788201187.918657:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 90 00000100:00100000:0.0:1788201187.918667:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:9974:x1875064614072448:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788201187.918690:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201187.918710:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787146 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e50 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201187.918967:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787146 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e50 expref: 27 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201187.918982:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787146 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e50 expref: 27 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201187.919063:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3d00) 00010000:00010000:0.0:1788201187.919066:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201187.919069:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676fa00, rc 0) 00000100:00100000:0.0:1788201187.919222:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:9974:x1875064614072448:12345-192.168.203.14@tcp:101:bash.0 Request processed in 555us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201187.919230:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 90 00000100:00100000:2.0:1788201187.928055:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201187.928386:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614072576 00000100:00100000:1.0:1788201187.928396:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614072576 00000100:00100000:1.0:1788201187.929051:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:1.0:1788201187.929064:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:9974:x1875064614072576:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788201187.929083:0:7765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201187.929105:0:7765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b78714d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e57 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201187.929169:0:7765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a95c8e0, atime: 0x6a95c8de, ctime: 0x6a95c8e0, blocks: 0xb 00010000:00010000:1.0:1788201187.929192:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=267s v=(0 0) 00010000:00010000:1.0:1788201187.929198:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201187.929206:0:7765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b78714d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e57 expref: 7 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.929243:0:7765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b78714d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e57 expref: 7 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201187.929256:0:7765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680000, rc 0) 00000100:00100000:1.0:1788201187.929323:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:9974:x1875064614072576:12345-192.168.203.14@tcp:101:bash.0 Request processed in 262us (1919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201187.929330:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00080000:3.0:1788201187.935369:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201187.935864:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201187.936107:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614072704 00000100:00100000:3.0:1788201187.936117:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614072704 00002000:00010000:3.0:1788201187.936196:0:6681:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788201187.936201:0:6681:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0035ef1500 with x1875064614072704 ext(0->18446744073709551615) 00002000:00010000:3.0:1788201187.936211:0:6681:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b0035ef1500. 00000100:00100000:3.0:1788201187.936246:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:3.0:1788201187.936256:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2348:x1875064614072704:12345-192.168.203.14@tcp:10:bash.0 00002000:00010000:3.0:1788201187.936719:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788201187.936723:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788201184 -> 1788201187 00002000:00010000:3.0:1788201187.936725:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788201182 -> 1788201182 00002000:00010000:3.0:1788201187.936739:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788201184 -> 1788201187 00002000:00010000:3.0:1788201187.936741:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788201187.936820:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2348:x1875064614072704:12345-192.168.203.14@tcp:10:bash.0 Request processed in 565us (963us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788201187.936829:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 1 00002000:00010000:3.0:1788201187.937095:0:6681:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788201187.937099:0:6681:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0035ef1500 with x1875064614072704 ext(0->18446744073709551615) 00002000:00010000:3.0:1788201187.937236:0:6681:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b0035ef1500. 00000100:00100000:0.0:1788201188.052408:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.056148:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614072832 00000100:00100000:1.0:1788201188.056163:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614072832 00000100:00100000:2.0:1788201188.056393:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 91 00000100:00100000:2.0:1788201188.056405:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:10468:x1875064614072832:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:2.0:1788201188.057233:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b787154 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.057251:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b787154 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.057263:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b787154 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.057279:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b78715b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.057365:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b78715b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.057386:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b78715b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058073:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787162 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058084:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058094:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201188.058159:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058171:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b787154 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058177:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b787154 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058184:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b787154 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058190:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201188.058194:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b787154 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058200:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b787154 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058211:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:2.0:1788201188.058220:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201188.058225:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b787154 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058231:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b787154 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058248:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b78715b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058254:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b78715b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058260:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b78715b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058264:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201188.058267:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b78715b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058273:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b78715b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058281:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b0011cb3100) 00010000:00010000:2.0:1788201188.058362:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201188.058366:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b78715b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058372:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b78715b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058387:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058399:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787162 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058405:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787162 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058411:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201188.058645:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787162 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058654:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787162 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058663:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3d00) 00010000:00010000:2.0:1788201188.058666:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201188.058669:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787162 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.058675:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787162 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201188.058993:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:10468:x1875064614072832:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 2577us (6580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201188.059005:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 91 00000100:00100000:2.0:1788201188.117185:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.117505:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614073088 00000100:00100000:1.0:1788201188.117517:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614073088 00000100:00100000:1.0:1788201188.117608:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 92 00000100:00100000:1.0:1788201188.117620:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:10471:x1875064614073088:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788201188.117653:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201188.117680:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787169 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e5e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.117779:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787170 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.117796:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787170 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.117820:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787170 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.117839:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787177 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.117951:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787177 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.117959:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787177 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.118962:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b78717e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.118978:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b78717e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.118988:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b78717e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201188.119002:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788201188.119417:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787170 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.119426:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787170 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.119434:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787170 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.119440:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201188.119445:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787170 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.119452:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787170 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.119478:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:1.0:1788201188.119481:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201188.119486:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787170 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.119493:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787170 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.119511:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787177 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.119517:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787177 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.119522:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787177 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.119528:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201188.119531:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787177 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.119536:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787177 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.119543:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b00033b2a00) 00010000:00010000:1.0:1788201188.119545:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201188.119547:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787177 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.119553:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787177 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.119669:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787169 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e5e expref: 30 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.119686:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b78717e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e5e expref: 29 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.119695:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3d00) 00010000:00010000:1.0:1788201188.119697:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788201188.119700:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fdc00, rc 0) 00000100:00100000:1.0:1788201188.119857:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+29:10471:x1875064614073088:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 2237us (2696us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788201188.119876:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 92 00000100:00100000:0.0:1788201188.126930:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.127083:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614073216 00000100:00100000:1.0:1788201188.127098:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614073216 00000100:00100000:1.0:1788201188.127211:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 93 00000100:00100000:1.0:1788201188.127224:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+29:10471:x1875064614073216:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:1.0:1788201188.127327:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78718c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.127353:0:9471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787131 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e49 expref: 29 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.127365:0:9471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78718c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.127419:0:9471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787131 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e49 expref: 29 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.127465:0:9471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787131 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e49 expref: 29 pid: 5829 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201188.127484:0:9471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9471:1875064622478720:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201188.127771:0:9471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00104f86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201188.130011:0:9471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9471:1875064622478720:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201188.130041:0:9471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78718c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201188.130914:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.130986:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614073472 00000100:00100000:1.0:1788201188.130996:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614073472 00000100:00100000:1.0:1788201188.131073:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:1.0:1788201188.131086:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+30:5586:x1875064614073472:12345-192.168.203.14@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788201188.131574:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:5586:x1875064614073472:12345-192.168.203.14@tcp:35:ldlm_bl.0 Request processed in 489us (662us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788201188.131588:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:2.0:1788201188.145118:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.145915:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614073600 00000100:00100000:1.0:1788201188.145931:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614073600 00010000:00010000:1.0:1788201188.145996:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787131 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e49 expref: 31 pid: 5829 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201188.146116:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:1.0:1788201188.146129:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:2348:x1875064614073600:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201188.146176:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201188.146207:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787131 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e49 expref: 31 pid: 5829 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.146224:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787131 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e49 expref: 31 pid: 5829 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.146255:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787131 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e49 expref: 31 pid: 5829 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.146279:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3d00) 00010000:00010000:1.0:1788201188.146286:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78718c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.146297:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78718c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.146307:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78718c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.146337:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201188.146414:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+30:2348:x1875064614073600:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 287us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201188.146423:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 48 00010000:00010000:0.0:1788201188.151227:0:9471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78718c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.151251:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78718c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.151305:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78718c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.151315:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78718c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.151323:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78718c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.151330:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fd400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201188.151335:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78718c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.151343:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78718c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.151365:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3d00) 00010000:00010000:0.0:1788201188.151369:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201188.151374:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78718c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.151380:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78718c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201188.151553:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+29:10471:x1875064614073216:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 24323us (24633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201188.151564:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 93 00000100:00100000:2.0:1788201188.160291:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.160405:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614073856 00000100:00100000:1.0:1788201188.160417:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614073856 00000100:00100000:1.0:1788201188.160495:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:1.0:1788201188.160512:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+29:10471:x1875064614073856:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788201188.160892:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+30:10471:x1875064614073856:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 385us (614us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788201188.160911:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:2.0:1788201188.271744:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.271870:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614074112 00000100:00100000:1.0:1788201188.271883:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614074112 00000100:00100000:1.0:1788201188.271966:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 94 00000100:00100000:1.0:1788201188.271979:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+30:10482:x1875064614074112:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:1.0:1788201188.272015:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201188.272043:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b787193 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e65 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.272200:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78719a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.272217:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78719a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.272230:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78719a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.272248:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7871a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.272255:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7871a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.272261:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7871a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.273995:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7871a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.274029:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7871a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.274041:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7871a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201188.274058:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788201188.274277:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78719a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.274287:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78719a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.274294:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78719a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.274301:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fd400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201188.274369:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78719a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.274378:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78719a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.274393:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:1.0:1788201188.274397:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201188.274402:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78719a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.274408:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b78719a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.274423:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7871a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.274435:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7871a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.274442:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7871a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.274447:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201188.274450:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7871a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.274456:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7871a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.274464:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b00033b2a00) 00010000:00010000:1.0:1788201188.274466:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201188.274539:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7871a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.274546:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7871a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.274700:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b787193 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e65 expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.274719:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7871a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e65 expref: 32 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.274728:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3d00) 00010000:00010000:1.0:1788201188.274730:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201188.274739:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681800, rc 0) 00000100:00100000:1.0:1788201188.274924:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:10482:x1875064614074112:12345-192.168.203.14@tcp:101:cat.0 Request processed in 2946us (3203us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788201188.274936:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 94 00000100:00100000:0.0:1788201188.284735:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.284867:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614074368 00000100:00100000:1.0:1788201188.284881:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614074368 00000100:00100000:1.0:1788201188.284961:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:1.0:1788201188.284974:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:10482:x1875064614074368:12345-192.168.203.14@tcp:35:cat.0 00000100:00100000:1.0:1788201188.285336:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+33:10482:x1875064614074368:12345-192.168.203.14@tcp:35:cat.0 Request processed in 364us (622us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788201188.285344:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:2.0:1788201188.300932:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201188.301907:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614074624 00000100:00100000:0.0:1788201188.301923:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614074624 00000100:00100000:0.0:1788201188.302067:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 95 00000100:00100000:0.0:1788201188.302090:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+33:10483:x1875064614074624:12345-192.168.203.14@tcp:36:rm.0 00010000:00010000:0.0:1788201188.302208:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788201188.302245:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7871a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e65 expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.302272:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b78717e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e5e expref: 32 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.302286:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787146 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e50 expref: 31 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.302298:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0011cb3d00) 00010000:00010000:0.0:1788201188.302311:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201188.302339:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7871b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.302356:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7871b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.302369:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7871b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.302405:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b7871bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.302413:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b7871bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.303255:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b7871bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.303924:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b7871c4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.303938:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b7871c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.303949:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b7871c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201188.304724:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1788201188.304736:0:5828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 267429601599ns, next at 268429598387ns, rc = 0 00010000:00010000:0.0:1788201188.304833:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7871cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.304846:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7871cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.304856:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7871cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.304865:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7871cb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.304884:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7871cb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.304891:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7871cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.304928:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201188.304962:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b7871c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.304970:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b7871c4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.304976:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b7871c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.304984:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676ee00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201188.304990:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b7871c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.304998:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b7871c4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.305000:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201188.305012:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7871cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.305017:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0002a80700) 00010000:00010000:0.0:1788201188.305024:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201188.305029:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b7871c4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.306863:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f400 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201188.307232:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7871cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.307308:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7871cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.307329:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b0002a80700) 00010000:00010000:3.0:1788201188.307332:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201188.307337:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7871cb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.307343:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7871cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.307371:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201188.307373:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201188.307377:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201188.307613:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b7871c4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.307654:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7871b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.307672:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7871b6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.307679:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7871b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.307685:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201188.307690:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7871b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.307696:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7871b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.307707:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:0.0:1788201188.307710:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201188.307713:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7871b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.307719:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7871b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201188.307742:0:5828:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005cdfb0d1 reply state 00000000a26fa120 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b7871bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201188.307754:0:5828:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201188.307892:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:10483:x1875064614074624:12345-192.168.203.14@tcp:36:rm.0 Request processed in 5798us (6968us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788201188.307903:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 95 00010000:00010000:0.0:1788201188.312950:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b7871bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.313000:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b7871bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.313010:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b7871bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.313017:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676fe00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201188.313023:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b7871bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.313033:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b7871bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.313056:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b0002a80200) 00010000:00010000:0.0:1788201188.313060:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201188.313066:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b7871bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.313073:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b7871bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201188.357946:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.359861:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614074880 00000100:00100000:1.0:1788201188.359880:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614074880 00000100:00100000:1.0:1788201188.359976:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 96 00000100:00100000:1.0:1788201188.359989:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:10489:x1875064614074880:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788201188.360024:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201188.360051:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7871d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e6c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.360387:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7871d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.360407:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7871d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.360419:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7871d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.360436:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b7871e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.360460:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b7871e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.360468:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b7871e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201188.365540:0:5827:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788201188.365802:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7871e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.365832:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7871e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.365846:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7871e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.365893:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7871d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.365900:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7871d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.365909:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7871d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.365916:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201188.365921:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7871d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.365930:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7871d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.365960:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:1.0:1788201188.365963:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201188.365969:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7871d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.365976:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7871d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201188.365993:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee6726e9 reply state 0000000016da4780 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b7871e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201188.366004:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201188.366052:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7871d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e6c expref: 34 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.366070:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7871e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e6c expref: 33 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.366079:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2300) 00010000:00010000:1.0:1788201188.366082:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201188.366084:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681800, rc 0) 00000100:00100000:1.0:1788201188.366250:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+34:10489:x1875064614074880:12345-192.168.203.14@tcp:101:bash.0 Request processed in 6263us (8321us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788201188.366261:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 96 00010000:00010000:3.0:1788201188.369959:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b7871e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.370552:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b7871e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.370560:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b7871e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.370571:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201188.370577:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b7871e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.370586:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b7871e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.370610:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b00033b2a00) 00010000:00010000:3.0:1788201188.370613:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201188.370619:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b7871e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.370627:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b7871e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201188.372204:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201188.372716:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614075008 00000100:00100000:0.0:1788201188.372729:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614075008 00000100:00100000:0.0:1788201188.372839:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:0.0:1788201188.372851:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2351:x1875064614075008:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788201188.372877:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201188.372907:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073d62f8c/0x72011f792b7871f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e73 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201188.372967:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201188.373010:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=267s v=(0 0) 00010000:00010000:0.0:1788201188.373016:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201188.373028:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073d62f8c/0x72011f792b7871f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e73 expref: 6 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.373052:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000073d62f8c/0x72011f792b7871f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e73 expref: 6 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.373067:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676fe00, rc 0) 00000100:00100000:0.0:1788201188.373248:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2351:x1875064614075008:12345-192.168.203.14@tcp:101:bash.0 Request processed in 398us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201188.373256:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00080000:2.0:1788201188.373653:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201188.376209:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.376351:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614075136 00000100:00100000:1.0:1788201188.376363:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614075136 00000100:00100000:1.0:1788201188.376430:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:1.0:1788201188.376441:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:10489:x1875064614075136:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788201188.376490:0:7765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201188.376514:0:7765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004018b410/0x72011f792b7871fc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e7a expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.376865:0:7765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000073d62f8c/0x72011f792b7871f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e73 expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.376876:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201188.376881:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201188.376887:0:7765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004018b410/0x72011f792b7871fc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e7a expref: 7 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.376932:0:7765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000073d62f8c/0x72011f792b7871f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e73 expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.376950:0:7765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000073d62f8c/0x72011f792b7871f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e73 expref: 7 pid: 6675 timeout: 367 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201188.376968:0:7765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7765:1875064622478848:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201188.377079:0:7765:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00104f8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201188.383867:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201188.384058:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614075264 00000100:00100000:0.0:1788201188.384070:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614075264 00010000:00010000:0.0:1788201188.384127:0:6691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000073d62f8c/0x72011f792b7871f5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e73 expref: 8 pid: 6675 timeout: 367 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201188.384202:0:7765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7765:1875064622478848:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788201188.384219:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:0.0:1788201188.384229:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000679bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2348:x1875064614075264:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201188.384241:0:7765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004018b410/0x72011f792b7871fc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e7a expref: 8 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.384246:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201188.384262:0:7765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681e00, rc 0) 00010000:00010000:0.0:1788201188.384274:0:6691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000073d62f8c/0x72011f792b7871f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e73 expref: 8 pid: 6675 timeout: 367 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.384310:0:6691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000073d62f8c/0x72011f792b7871f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e73 expref: 8 pid: 6675 timeout: 367 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.384340:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073d62f8c/0x72011f792b7871f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e73 expref: 8 pid: 6675 timeout: 367 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.384358:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201188.384364:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201188.384373:0:6691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004018b410/0x72011f792b7871fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e7a expref: 7 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.384385:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004018b410/0x72011f792b7871fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e7a expref: 7 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.384427:0:6691:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004018b410/0x72011f792b7871fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e7a expref: 7 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201188.384444:0:6691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f379500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6691:1875064622478976:192.168.203.14@tcp:105: 00000100:00100000:0.0:1788201188.384507:0:6691:0:(client.c:2702:ptlrpc_set_wait()) set ffff9aff01b6b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201188.384593:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:10489:x1875064614075136:12345-192.168.203.14@tcp:101:bash.0 Request processed in 8036us (8288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201188.384603:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:0.0:1788201188.390795:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201188.390982:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614075520 00000100:00100000:3.0:1788201188.390995:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614075520 00000100:00100000:3.0:1788201188.391061:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:3.0:1788201188.391072:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+33:10489:x1875064614075520:12345-192.168.203.14@tcp:35:bash.0 00000100:00100000:3.0:1788201188.391581:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+34:10489:x1875064614075520:12345-192.168.203.14@tcp:35:bash.0 Request processed in 508us (801us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788201188.391590:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:2.0:1788201188.392096:0:6691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f379500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6691:1875064622478976:192.168.203.14@tcp:105: 00010000:00010000:2.0:1788201188.392123:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201188.392954:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000679bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2348:x1875064614075264:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 8720us (9099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201188.392967:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:0.0:1788201188.583097:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.583264:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614075648 00000100:00100000:1.0:1788201188.583276:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614075648 00000100:00100000:1.0:1788201188.583338:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 97 00000100:00100000:1.0:1788201188.583347:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+34:10505:x1875064614075648:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788201188.583376:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201188.583415:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787203 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e81 expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.583521:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b78720a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.583539:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b78720a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.583553:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b78720a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201188.583636:0:9471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1788201188.583641:0:9471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201188.583669:0:9471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b78720a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.583701:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787203 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e81 expref: 36 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.583724:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b78720a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e81 expref: 35 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.583735:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:1.0:1788201188.583738:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201188.583743:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680e00, rc 0) 00000100:00100000:1.0:1788201188.584021:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:10505:x1875064614075648:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 671us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201188.584029:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 97 00000100:00100000:2.0:1788201188.589256:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.589337:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614075904 00000100:00100000:1.0:1788201188.589369:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614075904 00000100:00100000:2.0:1788201188.589456:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 98 00000100:00100000:2.0:1788201188.589472:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:10505:x1875064614075904:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788201188.589504:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201188.589542:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787211 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e88 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.589705:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b787218 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.589732:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b787218 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.589755:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b787218 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201188.589771:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788201188.592247:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787211 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e88 expref: 38 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.592291:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b787218 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e88 expref: 37 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.592303:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2300) 00010000:00010000:2.0:1788201188.592307:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201188.592312:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1800, rc 0) 00000100:00100000:2.0:1788201188.592413:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+37:10505:x1875064614075904:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 2945us (3172us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788201188.592424:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 98 00000100:00100000:2.0:1788201188.611368:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201188.611846:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614076032 00000100:00100000:3.0:1788201188.611859:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614076032 00000100:00100000:3.0:1788201188.611950:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:3.0:1788201188.611963:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+37:2349:x1875064614076032:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201188.611984:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201188.612015:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b787218 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e88 expref: 37 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.612044:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2300) 00010000:00010000:3.0:1788201188.612049:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201188.612129:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+36:2349:x1875064614076032:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 170us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201188.612178:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:2.0:1788201188.612294:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201188.613983:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614076288 00000100:00100000:3.0:1788201188.613998:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614076288 00000100:00100000:3.0:1788201188.614069:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 99 00000100:00100000:3.0:1788201188.614080:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+36:10505:x1875064614076288:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788201188.614120:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201188.614164:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787226 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e8f expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.614304:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b78722d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.614323:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b78722d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.614336:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b78722d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201188.614371:0:9471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788201188.614549:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787226 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e8f expref: 39 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.614575:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b78722d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e8f expref: 38 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.614585:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2300) 00010000:00010000:3.0:1788201188.614588:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788201188.614592:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c7800, rc 0) 00000100:00100000:3.0:1788201188.614666:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+38:10505:x1875064614076288:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 586us (2370us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788201188.614674:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 99 00000100:00100000:0.0:1788201188.620708:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.620829:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614076416 00000100:00100000:1.0:1788201188.620842:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614076416 00000100:00100000:1.0:1788201188.621012:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 36 00000100:00100000:1.0:1788201188.621026:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2350:x1875064614076416:12345-192.168.203.14@tcp:1:lfs.0 00010000:00010000:1.0:1788201188.621088:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d33ffef/0x72011f792b78723b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.621396:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004018b410/0x72011f792b7871fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e7a expref: 6 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.621407:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201188.621413:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201188.621418:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d33ffef/0x72011f792b78723b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.621463:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004018b410/0x72011f792b7871fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e7a expref: 6 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.621478:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004018b410/0x72011f792b7871fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e7a expref: 6 pid: 7765 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201188.621496:0:6675:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6675:1875064622479104:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201188.621616:0:6675:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00104f83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201188.626829:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.626994:0:6675:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6675:1875064622479104:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201188.627030:0:6675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d33ffef/0x72011f792b78723b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201188.627421:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614076544 00000100:00100000:2.0:1788201188.627430:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614076544 00002000:00100000:2.0:1788201188.627488:0:6683:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b003f379500 x1875064614076544/t0(0) o4->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:309/0 lens 504/0 e 0 to 0 dl 1788201199 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201188.627499:0:6683:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b003f379500 with x1875064614076544 ext(0->8) 00010000:00010000:2.0:1788201188.627507:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004018b410/0x72011f792b7871fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e7a expref: 7 pid: 7765 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.627523:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004018b410/0x72011f792b7871fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e7a expref: 7 pid: 7765 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201188.627539:0:6683:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b003f379500 00000100:00100000:2.0:1788201188.627574:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:2.0:1788201188.627585:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2349:x1875064614076544:12345-192.168.203.14@tcp:4:lfs.0 00000100:00100000:3.0:1788201188.630645:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:2349:x1875064614076544:12345-192.168.203.14@tcp:4:lfs.0 Request processed in 3047us (3815us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788201188.630663:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 1 00002000:00100000:3.0:1788201188.630677:0:6683:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b003f379500 x1875064614076544/t4294967302(0) o4->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:309/0 lens 504/448 e 0 to 0 dl 1788201199 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201188.630688:0:6683:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b003f379500 with x1875064614076544 ext(0->8) 00010000:00010000:3.0:1788201188.630700:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004018b410/0x72011f792b7871fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e7a expref: 9 pid: 7765 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.630722:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004018b410/0x72011f792b7871fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e7a expref: 9 pid: 7765 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201188.630748:0:6683:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b003f379500 00000100:00100000:2.0:1788201188.636115:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201188.636798:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614076672 00000100:00100000:3.0:1788201188.636819:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614076672 00010000:00010000:0.0:1788201188.636949:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004018b410/0x72011f792b7871fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e7a expref: 9 pid: 7765 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201188.637018:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 50 00000100:00100000:0.0:1788201188.637029:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:2348:x1875064614076672:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201188.637049:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788201188.637083:0:5812:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788201188.637086:0:5812:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788201188 00002000:00010000:0.0:1788201188.637088:0:5812:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788201188 00002000:00010000:0.0:1788201188.637090:0:5812:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788201188 00010000:00010000:0.0:1788201188.637096:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004018b410/0x72011f792b7871fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e7a expref: 9 pid: 7765 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.637109:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004018b410/0x72011f792b7871fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e7a expref: 9 pid: 7765 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.637172:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004018b410/0x72011f792b7871fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e7a expref: 9 pid: 7765 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.637193:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788201188.637385:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788201188.637394:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d33ffef/0x72011f792b78723b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.637406:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d33ffef/0x72011f792b78723b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.637435:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201188.637569:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2348:x1875064614076672:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 542us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201188.637578:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 50 00010000:00010000:1.0:1788201188.637688:0:6675:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d33ffef/0x72011f792b78723b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.637699:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d33ffef/0x72011f792b78723b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.637731:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d33ffef/0x72011f792b78723b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.637739:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d33ffef/0x72011f792b78723b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.637748:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d33ffef/0x72011f792b78723b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.637757:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680600 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201188.637762:0:6675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d33ffef/0x72011f792b78723b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.637772:0:6675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d33ffef/0x72011f792b78723b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.637786:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d33ffef/0x72011f792b78723b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.637817:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d33ffef/0x72011f792b78723b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201188.637879:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2350:x1875064614076416:12345-192.168.203.14@tcp:1:lfs.0 Request processed in 16856us (17186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201188.637887:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 36 00000100:00100000:0.0:1788201188.643301:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201188.643573:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614076928 00000100:00100000:3.0:1788201188.643585:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614076928 00000100:00100000:3.0:1788201188.643993:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:3.0:1788201188.644009:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002289dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+38:10505:x1875064614076928:12345-192.168.203.14@tcp:35:lfs.0 00000004:00010000:3.0:1788201188.644107:0:5831:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b78722d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e8f expref: 38 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201188.644461:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788201188.644505:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1788201188.644975:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:3.0:1788201188.645036:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787242 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.645056:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7871e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e6c expref: 42 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.645065:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787242 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.645109:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7871e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e6c expref: 42 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.645125:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7871e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e6c expref: 42 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201188.645193:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040678380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5831:1875064622479232:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201188.646072:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0006315780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201188.649446:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040678380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5831:1875064622479232:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788201188.649491:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787242 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201188.650280:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201188.650561:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614077056 00000100:00100000:3.0:1788201188.650572:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614077056 00010000:00010000:3.0:1788201188.650629:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7871e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e6c expref: 43 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201188.650670:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00100000:3.0:1788201188.650681:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+43:2349:x1875064614077056:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201188.650701:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201188.650708:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7871e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e6c expref: 43 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.650723:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7871e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e6c expref: 43 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.650749:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7871e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e6c expref: 43 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.650771:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2300) 00010000:00010000:3.0:1788201188.650776:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787242 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.650796:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787242 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.650816:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787242 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.650853:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201188.650913:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+42:2349:x1875064614077056:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 233us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201188.650921:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 51 00010000:00010000:2.0:1788201188.651125:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787242 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.651177:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787242 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201188.651341:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:2.0:1788201188.651748:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788201188.651892:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0003ee4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5831:1875064622479360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788201188.651955:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201188.651994:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201188.652968:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622479360 00000100:00100000:3.0:1788201188.652980:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622479360 00000100:00080000:1.0:1788201188.653352:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201188.653684:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201188.653695:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5831:x1875064622479360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788201188.653827:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5831:x1875064622479360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 134us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201188.653835:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201188.654031:0:5831:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1788201188.654037:0:5831:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1788201188.654059:0:5831:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0035c04e00, transno 4294967301 00000100:00100000:2.0:1788201188.654073:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0003ee4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5831:1875064622479360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788201188.654595:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788201188.654673:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5831:1875064622479488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788201188.654729:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201188.654764:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201188.654780:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622479488 00000100:00100000:0.0:1788201188.654787:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622479488 00000100:00100000:0.0:1788201188.654842:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788201188.654851:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1875064622479488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788201188.655007:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1875064622479488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 157us (289us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788201188.655015:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201188.655035:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00408e1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5831:1875064622479488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788201188.655121:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788201188.655193:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787242 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.655204:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787242 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.655213:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787242 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.655220:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201188.655225:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787242 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.655234:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787242 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.655254:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2300) 00010000:00010000:2.0:1788201188.655258:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788201188.655263:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787242 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.655270:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787242 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201188.655420:0:5831:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788201188.655513:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788201188.655527:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 267780392699ns, next at 268780390173ns, rc = 0 00000001:00080000:2.0:1788201188.655534:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1788201188.655566:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2300) 00010000:00010000:2.0:1788201188.655569:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788201188.655576:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b78722d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e8f expref: 46 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201188.655702:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002289dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+45:10505:x1875064614076928:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 11697us (12415us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788201188.655710:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 26 00000020:00080000:2.0:1788201188.655714:0:5831:0:(tgt_main.c:807:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788201188.657875:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.658031:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614077184 00000100:00100000:1.0:1788201188.658042:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614077184 00000100:00100000:1.0:1788201188.658119:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 100 00000100:00100000:1.0:1788201188.658130:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+45:10505:x1875064614077184:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788201188.658406:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201188.658526:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787249 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e96 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.659034:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787249 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e96 expref: 46 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.659053:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787249 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e96 expref: 46 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.659077:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:1.0:1788201188.659080:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201188.659084:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680600, rc 0) 00000100:00100000:1.0:1788201188.659400:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+46:10505:x1875064614077184:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1269us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201188.659927:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 100 00000100:00100000:0.0:1788201188.675957:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.676107:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614077440 00000100:00100000:1.0:1788201188.676121:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614077440 00000100:00100000:1.0:1788201188.676242:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:1.0:1788201188.676254:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+46:10505:x1875064614077440:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788201188.676603:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+47:10505:x1875064614077440:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 351us (658us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788201188.676613:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:2.0:1788201188.785402:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201188.785506:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614077568 00000100:00100000:3.0:1788201188.785519:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614077568 00000100:00100000:3.0:1788201188.785610:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 101 00000100:00100000:3.0:1788201188.785622:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+47:10515:x1875064614077568:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:3.0:1788201188.785724:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787250 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.785747:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787250 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.785761:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787250 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.785798:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787257 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.785818:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.785825:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.785960:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b78725e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.785969:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b78725e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.785977:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b78725e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201188.786032:0:9471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b78725e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786046:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787250 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786052:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787250 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786060:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787250 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786068:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201188.786073:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787250 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786088:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787250 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786101:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:3.0:1788201188.786105:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201188.786109:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787250 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786116:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787250 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786319:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786327:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787257 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786333:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786339:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201188.786342:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786349:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787257 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786358:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b00109a1f00) 00010000:00010000:3.0:1788201188.786360:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201188.786363:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787257 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786380:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b787257 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786402:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b78725e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786409:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b78725e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786415:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b78725e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786421:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201188.786424:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b78725e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786429:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b78725e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786437:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:3.0:1788201188.786439:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201188.786442:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b78725e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.786448:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b78725e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201188.786548:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+47:10515:x1875064614077568:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 926us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201188.786559:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 101 00010000:00010000:1.0:1788201188.812637:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201188.841374:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.841547:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614077824 00000100:00100000:1.0:1788201188.841559:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614077824 00000100:00100000:1.0:1788201188.841641:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 102 00000100:00100000:1.0:1788201188.841653:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+47:10518:x1875064614077824:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788201188.841681:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201188.841709:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787265 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2e9d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.841814:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b78726c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.841832:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b78726c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.841844:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b78726c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.841862:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787273 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.841887:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.841895:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.842067:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b78727a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.842077:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b78727a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.842085:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b78727a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201188.842096:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788201188.842720:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b78726c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.842732:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b78726c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.842751:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b78726c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.842758:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201188.842763:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b78726c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.842771:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b78726c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.842918:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:1.0:1788201188.842921:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201188.842927:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b78726c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.842935:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b78726c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.842953:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.842960:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787273 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.842968:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787273 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.842974:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fdc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201188.842977:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787273 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.842983:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787273 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.842991:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b00033b2b00) 00010000:00010000:1.0:1788201188.842994:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201188.842997:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787273 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.843003:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787273 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.843069:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787265 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e9d expref: 50 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.843085:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b78727a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e9d expref: 49 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.843092:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:1.0:1788201188.843095:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201188.843450:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fcc00, rc 0) 00000100:00100000:1.0:1788201188.843740:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+49:10518:x1875064614077824:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 2086us (2379us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788201188.843752:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 102 00000100:00100000:2.0:1788201188.851563:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.851831:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614077952 00000100:00100000:1.0:1788201188.851845:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614077952 00000100:00100000:1.0:1788201188.851923:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 103 00000100:00100000:1.0:1788201188.851935:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+49:10518:x1875064614077952:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:1.0:1788201188.852037:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787288 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.852063:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787288 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.852078:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787288 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.852116:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787288 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.852410:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787288 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.852419:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787288 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.852426:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fdc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201188.852431:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787288 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.852445:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787288 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.852463:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:1.0:1788201188.852467:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201188.852472:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787288 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.852479:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b787288 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201188.852662:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+49:10518:x1875064614077952:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 728us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201188.852674:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 103 00000100:00100000:2.0:1788201188.855970:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.856049:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614078208 00000100:00100000:1.0:1788201188.856061:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614078208 00000100:00100000:1.0:1788201188.856130:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:1.0:1788201188.856178:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+49:10518:x1875064614078208:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788201188.856814:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+50:10518:x1875064614078208:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 626us (846us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788201188.856842:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:2.0:1788201188.935891:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.936005:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614078464 00000100:00100000:1.0:1788201188.936018:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614078464 00000100:00100000:1.0:1788201188.936238:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 104 00000100:00100000:1.0:1788201188.936252:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+50:10528:x1875064614078464:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788201188.936288:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201188.936291:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788201188.936327:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b78720a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e81 expref: 50 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.936351:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:1.0:1788201188.936356:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201188.936372:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b78728f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2ea4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.936501:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787296 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.936518:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b78727a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e9d expref: 50 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.936527:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787296 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.936567:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b78727a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e9d expref: 50 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.936582:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b78727a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e9d expref: 50 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201188.936616:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5829:1875064622479616:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788201188.940080:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201188.940247:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614078592 00000100:00100000:3.0:1788201188.940259:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614078592 00010000:00010000:3.0:1788201188.940311:0:6691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b78727a lrc: 6/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e9d expref: 51 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201188.940360:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:3.0:1788201188.940372:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+51:2348:x1875064614078592:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201188.940393:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201188.940401:0:6691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b78727a lrc: 6/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e9d expref: 51 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.940427:0:6691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b78727a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e9d expref: 51 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.940457:0:6691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:3.0:1788201188.940465:0:6691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787296 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.940476:0:6691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787296 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.940485:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787296 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.940516:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201188.940584:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+51:2348:x1875064614078592:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 214us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201188.940593:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:0.0:1788201188.941572:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00104f86c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788201188.941612:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b78727a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e9d expref: 50 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201188.941634:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5829:1875064622479616:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788201188.941660:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787296 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.941671:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787296 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.941678:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787296 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201188.941699:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788201188.941918:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b78728f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ea4 expref: 51 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.941934:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787296 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ea4 expref: 50 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.941943:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:0.0:1788201188.941947:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788201188.941950:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fd400, rc 0) 00000100:00100000:0.0:1788201188.942001:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+50:10528:x1875064614078464:12345-192.168.203.14@tcp:101:bash.0 Request processed in 5753us (6125us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1788201188.942009:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 104 00000100:00100000:2.0:1788201188.947564:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201188.947659:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614078848 00000100:00100000:3.0:1788201188.947691:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614078848 00000100:00100000:3.0:1788201188.947817:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 105 00000100:00100000:3.0:1788201188.947829:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+50:10528:x1875064614078848:12345-192.168.203.14@tcp:36:bash.0 00010000:00010000:3.0:1788201188.948306:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b7872a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.948329:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b7872a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201188.948343:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b7872a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201188.948406:0:9471:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:3.0:1788201188.948444:0:9471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007bff40c7 reply state 00000000c0429c4e transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b7872a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201188.948456:0:9471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201188.948585:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+53:10528:x1875064614078848:12345-192.168.203.14@tcp:36:bash.0 Request processed in 756us (1500us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1788201188.948594:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 105 00000020:00080000:3.0:1788201188.948600:0:9471:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788201188.951331:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b7872a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.951354:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b7872a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.951363:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b7872a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.951370:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201188.951375:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b7872a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.951388:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b7872a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.951411:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:0.0:1788201188.951425:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201188.951453:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b7872a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201188.951460:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b7872a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201188.954953:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.955169:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614078976 00000100:00100000:1.0:1788201188.955184:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614078976 00000100:00100000:1.0:1788201188.957646:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 106 00000100:00100000:1.0:1788201188.957677:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+52:10528:x1875064614078976:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788201188.957716:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201188.957747:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b7872ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2eab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.957884:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7872b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.957902:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787296 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ea4 expref: 53 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.957912:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7872b2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.957959:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787296 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ea4 expref: 53 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.957976:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787296 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ea4 expref: 53 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201188.957995:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5827:1875064622479744:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201188.958103:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00104f8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201188.962934:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201188.963095:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614079104 00000100:00100000:2.0:1788201188.963107:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614079104 00010000:00010000:2.0:1788201188.963192:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787296 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ea4 expref: 54 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201188.963248:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:2.0:1788201188.963259:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040678380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+54:2349:x1875064614079104:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201188.963396:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201188.963407:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787296 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ea4 expref: 54 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.963432:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787296 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ea4 expref: 54 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.963488:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:2.0:1788201188.963493:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7872b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.963505:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7872b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.963514:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7872b2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201188.963536:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201188.963609:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040678380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+54:2349:x1875064614079104:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 351us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201188.963618:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 53 00010000:00010000:1.0:1788201188.963781:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787296 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ea4 expref: 53 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201188.963809:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5827:1875064622479744:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201188.963838:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7872b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.963848:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7872b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.963855:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7872b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201188.963916:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788201188.963921:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201188.963945:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7872b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.963979:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b7872ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eab expref: 53 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.963993:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7872b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eab expref: 52 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201188.964001:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:1.0:1788201188.964004:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201188.964006:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fcc00, rc 0) 00000100:00100000:1.0:1788201188.964035:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+52:10528:x1875064614078976:12345-192.168.203.14@tcp:101:bash.0 Request processed in 6376us (9099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201188.964041:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 106 00000100:00100000:2.0:1788201188.971672:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201188.971766:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614079360 00000100:00100000:1.0:1788201188.971779:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614079360 00000100:00100000:1.0:1788201188.971848:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:1.0:1788201188.971860:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+52:10528:x1875064614079360:12345-192.168.203.14@tcp:35:bash.0 00000100:00100000:1.0:1788201188.972269:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+53:10528:x1875064614079360:12345-192.168.203.14@tcp:35:bash.0 Request processed in 409us (612us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788201188.972482:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:0.0:1788201189.024637:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201189.024898:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614079488 00000100:00100000:1.0:1788201189.024911:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614079488 00000100:00100000:1.0:1788201189.025015:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 107 00000100:00100000:1.0:1788201189.025027:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+53:10534:x1875064614079488:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788201189.025070:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201189.025172:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b7872b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2eb2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.025262:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b7872c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.025297:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b7872c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.025311:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b7872c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201189.025393:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1788201189.025398:0:5828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201189.025599:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b7872c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.025632:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b7872b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eb2 expref: 55 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.025678:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b7872c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eb2 expref: 54 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.025688:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:1.0:1788201189.025691:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201189.025696:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fd400, rc 0) 00000100:00100000:1.0:1788201189.025795:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+54:10534:x1875064614079488:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 770us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.025813:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 107 00000100:00080000:2.0:1788201189.025902:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201189.029233:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201189.030593:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614079616 00000100:00100000:0.0:1788201189.030612:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614079616 00000100:00100000:0.0:1788201189.030694:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 108 00000100:00100000:0.0:1788201189.030706:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+54:10534:x1875064614079616:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788201189.030743:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201189.030770:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b7872c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2eb9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.030860:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b7872ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.030875:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b7872ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.030887:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b7872ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.030903:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7872d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.030910:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7872d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.030916:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7872d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031058:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b7872dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031067:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b7872dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031075:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b7872dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201189.031129:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788201189.031198:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201189.031222:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b7872dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031236:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b7872dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031245:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b7872ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031252:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b7872ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031264:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b7872ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031270:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676e400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201189.031275:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b7872ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031283:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b7872ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031305:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:0.0:1788201189.031308:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201189.031314:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b7872ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031320:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b7872ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031338:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7872d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031344:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7872d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031349:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7872d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031354:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201189.031357:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7872d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031363:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7872d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031369:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b0002a80100) 00010000:00010000:0.0:1788201189.031371:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201189.031374:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7872d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031379:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7872d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031853:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b7872c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eb9 expref: 56 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031872:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b7872dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eb9 expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.031880:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:0.0:1788201189.031883:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201189.031886:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676fc00, rc 0) 00000100:00100000:0.0:1788201189.031975:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+55:10534:x1875064614079616:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1271us (2756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201189.031984:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 108 00000100:00100000:0.0:1788201189.037677:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201189.037731:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201189.037861:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614080000 00000100:00100000:3.0:1788201189.037875:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614080000 00000100:00100000:3.0:1788201189.037963:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:3.0:1788201189.037976:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+55:2349:x1875064614080000:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201189.037997:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201189.038030:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b7872dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eb9 expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.038078:0:6691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:3.0:1788201189.038084:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201189.038269:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614079872 00000100:00100000:1.0:1788201189.038275:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614079872 00000100:00100000:1.0:1788201189.038334:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 109 00000100:00100000:1.0:1788201189.038343:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+55:10534:x1875064614079872:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788201189.038364:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201189.038384:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b7872e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2ec0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.038773:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7872ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.038790:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7872b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eab expref: 56 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.038810:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7872ea lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.038852:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7872b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eab expref: 56 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.038876:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7872b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eab expref: 56 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.038892:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5828:1875064622479872:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201189.039040:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00104f8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201189.039251:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+56:2349:x1875064614080000:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 1277us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201189.039262:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:2.0:1788201189.044490:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201189.044822:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614080128 00000100:00100000:3.0:1788201189.044835:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614080128 00010000:00010000:3.0:1788201189.044889:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7872b2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eab expref: 56 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.044985:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00100000:3.0:1788201189.044996:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000679a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+56:2348:x1875064614080128:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201189.045045:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201189.045055:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7872b2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eab expref: 56 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.045070:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7872b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eab expref: 56 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.045099:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:3.0:1788201189.045104:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7872ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.045116:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7872ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.045124:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7872ea lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.045287:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201189.045581:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000679a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+56:2348:x1875064614080128:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 585us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201189.045600:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 54 00010000:00010000:1.0:1788201189.045736:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7872b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eab expref: 55 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.045758:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5828:1875064622479872:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201189.045783:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7872ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.045794:0:5828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7872ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.045816:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7872ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201189.045839:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788201189.046032:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b7872e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ec0 expref: 56 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.046049:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7872ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ec0 expref: 55 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.046058:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:1.0:1788201189.046070:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788201189.046073:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680e00, rc 0) 00000100:00100000:1.0:1788201189.046108:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+55:10534:x1875064614079872:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 7766us (8446us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1788201189.046116:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 109 00000100:00100000:2.0:1788201189.050390:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201189.050657:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614080384 00000100:00100000:3.0:1788201189.050668:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614080384 00000100:00100000:3.0:1788201189.050788:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:3.0:1788201189.050811:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+55:10534:x1875064614080384:12345-192.168.203.14@tcp:103:lfs.0 00010000:00010000:3.0:1788201189.050835:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201189.050867:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787249 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e96 expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.050891:0:6691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:3.0:1788201189.050897:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201189.050971:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+54:10534:x1875064614080384:12345-192.168.203.14@tcp:103:lfs.0 Request processed in 173us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201189.050980:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:2.0:1788201189.053966:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201189.054046:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614080512 00000100:00100000:1.0:1788201189.054058:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614080512 00000100:00100000:1.0:1788201189.054129:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 110 00000100:00100000:1.0:1788201189.054180:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+54:10534:x1875064614080512:12345-192.168.203.14@tcp:58:lfs.0 00010000:00010000:1.0:1788201189.054355:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7872f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.054375:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7872f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.054387:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7872f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201189.055034:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788201189.055255:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+54:10534:x1875064614080512:12345-192.168.203.14@tcp:58:lfs.0 Request processed in 1077us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.055265:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 110 00000100:00100000:2.0:1788201189.058785:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201189.058932:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614080640 00000100:00100000:3.0:1788201189.058945:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614080640 00000100:00100000:3.0:1788201189.059017:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 111 00000100:00100000:3.0:1788201189.059029:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+54:10534:x1875064614080640:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788201189.059058:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201189.059083:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7872ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2ec7 expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.059197:0:9471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7872f8 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.059227:0:9471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7872ff lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ec7 expref: 55 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.059250:0:9471:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7872f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.059272:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7872ff lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ec7 expref: 55 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.059508:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:3.0:1788201189.059514:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201189.059519:0:9471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7872ff lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ec7 expref: 55 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.059528:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c7e00, rc 0) 00000100:00100000:3.0:1788201189.059703:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+55:10534:x1875064614080640:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 674us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201189.059711:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 111 00000040:00080000:3.0:1788201189.131927:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788201189.131941:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788201189.132030:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788201189.132042:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788201189.134325:0:11684:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035da2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875064622480000:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788201189.134470:0:11684:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00063156c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201189.139413:0:11684:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035da2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875064622480000:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788201189.141944:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201189.142191:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614080768 00000100:00100000:0.0:1788201189.142202:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614080768 00000100:00100000:0.0:1788201189.142255:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 112 00000100:00100000:0.0:1788201189.142265:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+55:10535:x1875064614080768:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788201189.142318:0:5829:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788201189.142411:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+55:10535:x1875064614080768:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 146us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201189.142419:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 112 00000100:00100000:2.0:1788201189.148980:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201189.149069:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614081024 00000100:00100000:0.0:1788201189.149080:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614081024 00000100:00100000:0.0:1788201189.149174:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 282 00000100:00100000:0.0:1788201189.149185:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2349:x1875064614081024:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201189.149268:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2349:x1875064614081024:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 85us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201189.149276:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 282 00000100:00100000:2.0:1788201189.151867:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201189.152024:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201189.154596:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614081152 00000100:00100000:3.0:1788201189.154625:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614081152 00000100:00100000:3.0:1788201189.154764:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:3.0:1788201189.154776:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2348:x1875064614081152:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201189.154855:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2348:x1875064614081152:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 83us (2831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201189.154863:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:0.0:1788201189.154971:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00080000:2.0:1788201189.155024:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201189.157620:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614081280 00000100:00100000:1.0:1788201189.157634:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614081280 00000100:00080000:0.0:1788201189.157690:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201189.157709:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614080896 00000100:00100000:1.0:1788201189.157714:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614080896 00000100:00100000:3.0:1788201189.163277:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 124 00000100:00100000:3.0:1788201189.163305:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2349:x1875064614081280:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201189.163468:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2349:x1875064614081280:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 176us (11607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201189.163477:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 124 00000100:00100000:3.0:1788201189.163505:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 113 00000100:00100000:3.0:1788201189.163513:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+55:10535:x1875064614080896:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788201189.163575:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787306 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.163592:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787306 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.163602:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787306 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164316:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b78730d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164329:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b78730d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164414:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b78730d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164443:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787314 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164452:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787314 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164460:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787314 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201189.164503:0:9471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788201189.164508:0:9471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201189.164522:0:9471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787314 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164534:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787306 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164540:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787306 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164546:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787306 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164553:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201189.164557:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787306 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164564:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787306 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164582:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b0011cb3e00) 00010000:00010000:3.0:1788201189.164585:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201189.164589:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787306 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164595:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787306 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164608:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b78730d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164613:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b78730d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164758:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b78730d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164763:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201189.164767:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b78730d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164773:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b78730d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164782:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9b00109a1f00) 00010000:00010000:3.0:1788201189.164784:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201189.164786:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b78730d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164791:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b78730d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164827:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787314 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164834:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787314 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164839:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787314 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164844:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201189.164847:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787314 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164852:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787314 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164860:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:3.0:1788201189.164863:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201189.164866:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787314 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.164871:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787314 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.164991:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+55:10535:x1875064614080896:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 Request processed in 1475us (10017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201189.165000:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 113 00000100:00100000:0.0:1788201189.166789:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201189.166880:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614081536 00000100:00100000:1.0:1788201189.166891:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614081536 00000100:00100000:1.0:1788201189.166992:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 114 00000100:00100000:1.0:1788201189.167002:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+55:10535:x1875064614081536:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201189.167039:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201189.167059:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b78731b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2ece expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.167194:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787322 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.167210:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.167220:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201189.167231:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788201189.167328:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.167336:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787322 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.167344:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.167350:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201189.167355:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.167362:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787322 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.167373:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:1.0:1788201189.167383:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788201189.167388:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787322 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.167394:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787322 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.167433:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b78731b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ece expref: 57 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.167442:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b0011cb3e00) 00010000:00010000:1.0:1788201189.167445:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201189.167450:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b78731b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ece expref: 57 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.167458:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681e00, rc 0) 00000100:00100000:1.0:1788201189.167509:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+56:10535:x1875064614081536:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 508us (728us total) trans 4294967398 rc 301/301 00000100:00100000:1.0:1788201189.167515:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 114 00000100:00100000:2.0:1788201189.176178:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201189.176856:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614081664 00000100:00100000:0.0:1788201189.176866:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614081664 00000100:00100000:0.0:1788201189.176971:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 115 00000100:00100000:0.0:1788201189.176982:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+56:10535:x1875064614081664:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788201189.177016:0:5829:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788201189.177116:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+56:10535:x1875064614081664:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 135us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201189.177124:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 115 00000100:00100000:2.0:1788201189.182201:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201189.182381:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614081920 00000100:00100000:0.0:1788201189.182389:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614081920 00000100:00100000:0.0:1788201189.182433:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 116 00000100:00100000:0.0:1788201189.182440:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+56:10535:x1875064614081920:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201189.182457:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201189.182459:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788201189.182480:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b7872c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eb2 expref: 56 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.182495:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:0.0:1788201189.182500:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201189.182516:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787330 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2ed5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201189.182939:0:5828:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788201189.183201:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b787337 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.183215:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b787337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.183226:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b787337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.183285:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787330 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ed5 expref: 58 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.183300:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b787337 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ed5 expref: 57 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.183307:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b0002a80100) 00010000:00010000:0.0:1788201189.183310:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201189.183313:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676e400, rc 0) 00000100:00100000:0.0:1788201189.183376:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+57:10535:x1875064614081920:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 936us (1183us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1788201189.183384:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 116 00000100:00100000:2.0:1788201189.199024:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201189.199189:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614082176 00000100:00100000:3.0:1788201189.199200:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614082176 00000100:00100000:0.0:1788201189.199530:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 117 00000100:00100000:0.0:1788201189.199545:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+57:10535:x1875064614082176:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788201189.199602:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201189.199628:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b787337 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ed5 expref: 57 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.199656:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b0002a80100) 00010000:00010000:0.0:1788201189.199669:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201189.199689:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787345 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.199702:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.199841:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.199987:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b78734c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x855990e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.199996:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b78734c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x855990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.200004:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b78734c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x855990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.200078:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.200085:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787345 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.200092:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787345 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.200097:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201189.200322:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787345 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.200340:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787345 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.200351:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:0.0:1788201189.200354:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201189.200444:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787345 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.200452:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787345 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.200464:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b78734c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x855990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.200471:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b78734c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x855990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.200476:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b78734c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x855990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.200481:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676ec00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201189.200484:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b78734c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x855990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.200489:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b78734c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x855990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.200497:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x855990e9 (ffff9b0002a80d00) 00010000:00010000:0.0:1788201189.200500:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201189.200503:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b78734c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x855990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.200517:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b78734c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x855990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201189.200707:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+56:10535:x1875064614082176:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 1165us (1690us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201189.200716:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 117 00000100:00100000:3.0:1788201189.203128:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201189.203253:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614082304 00000100:00100000:0.0:1788201189.203263:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614082304 00000100:00100000:0.0:1788201189.203311:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 118 00000100:00100000:0.0:1788201189.203322:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+56:10535:x1875064614082304:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201189.203341:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201189.203364:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787353 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2edc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.203398:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78735a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.203410:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78735a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.203421:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78735a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.203508:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787353 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2edc expref: 58 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.203526:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78735a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2edc expref: 57 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.203545:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:0.0:1788201189.203548:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788201189.203551:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676fa00, rc 0) 00000100:00100000:0.0:1788201189.205101:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+57:10535:x1875064614082304:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 1771us (1970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201189.205113:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 118 00000100:00100000:2.0:1788201189.217006:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201189.217438:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614082560 00000100:00100000:0.0:1788201189.217453:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614082560 00000100:00100000:0.0:1788201189.217530:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 119 00000100:00100000:0.0:1788201189.217541:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+57:10535:x1875064614082560:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788201189.217622:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787361 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.217638:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.217649:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201189.217907:0:9471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:0.0:1788201189.217999:0:9471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e429cd94 reply state 00000000356fb034 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201189.218010:0:9471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201189.218114:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+59:10535:x1875064614082560:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 574us (1123us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788201189.218121:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 119 00000100:00100000:2.0:1788201189.221605:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201189.222130:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614082688 00000100:00100000:1.0:1788201189.222179:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614082688 00000100:00100000:1.0:1788201189.222243:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 120 00000100:00100000:1.0:1788201189.222253:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+59:10535:x1875064614082688:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201189.222278:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201189.222299:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787368 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2ee3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.222360:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787368 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ee3 expref: 60 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.222388:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787368 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ee3 expref: 60 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.222408:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:1.0:1788201189.222410:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201189.222414:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681e00, rc 0) 00000100:00100000:1.0:1788201189.222467:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+60:10535:x1875064614082688:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 216us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.222474:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 120 00010000:00010000:3.0:1788201189.222972:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.222983:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787361 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.222990:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787361 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.222997:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201189.223001:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787361 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.223009:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787361 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.223023:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:3.0:1788201189.223026:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201189.223029:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787361 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.223035:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787361 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.230106:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201189.230384:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614082816 00000100:00100000:0.0:1788201189.230394:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614082816 00000100:00100000:0.0:1788201189.230440:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 37 00000100:00100000:0.0:1788201189.230449:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2349:x1875064614082816:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788201189.230750:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:2349:x1875064614082816:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 300us (653us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788201189.230758:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 37 00000100:00100000:2.0:1788201189.233573:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201189.233814:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614083072 00000100:00100000:1.0:1788201189.233825:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614083072 00000100:00100000:1.0:1788201189.233883:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00100000:1.0:1788201189.233894:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+59:10535:x1875064614083072:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788201189.234107:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+60:10535:x1875064614083072:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 214us (543us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788201189.234114:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00100000:2.0:1788201189.237414:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201189.237522:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614083328 00000100:00100000:0.0:1788201189.237537:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614083328 00000100:00100000:0.0:1788201189.237619:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 121 00000100:00100000:0.0:1788201189.237629:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+60:10535:x1875064614083328:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788201189.237766:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+60:10535:x1875064614083328:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 137us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201189.237773:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 121 00000100:00100000:3.0:1788201189.243873:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201189.246430:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614083456 00000100:00100000:1.0:1788201189.246444:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614083456 00000100:00100000:1.0:1788201189.246520:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 122 00000100:00100000:1.0:1788201189.246531:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+60:10535:x1875064614083456:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201189.246552:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201189.246573:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b78736f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2eea expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.246690:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787376 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.246712:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.246724:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201189.246763:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201189.246782:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.246819:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b78736f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eea expref: 62 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.246839:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787376 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eea expref: 61 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.246848:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:1.0:1788201189.246851:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788201189.246855:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fd400, rc 0) 00000100:00100000:1.0:1788201189.246926:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+61:10535:x1875064614083456:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 397us (3067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.246933:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 122 00000100:00100000:3.0:1788201189.251778:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201189.251942:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614083584 00000100:00100000:2.0:1788201189.251956:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614083584 00000100:00100000:2.0:1788201189.252034:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 38 00000100:00100000:2.0:1788201189.252046:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:2349:x1875064614083584:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201189.252071:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201189.252275:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008808c783/0x72011f792b78737d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2ef1 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201189.252311:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95c8e5, blocks: 0x1 00010000:00010000:2.0:1788201189.252338:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=268s v=(0 0) 00010000:00010000:2.0:1788201189.252344:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201189.252357:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008808c783/0x72011f792b78737d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef1 expref: 10 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.252380:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008808c783/0x72011f792b78737d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef1 expref: 10 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.252396:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1a00, rc 0) 00000100:00100000:2.0:1788201189.252524:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+10:2349:x1875064614083584:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 480us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201189.252532:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 38 00000100:00100000:2.0:1788201189.254867:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201189.255016:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614083840 00000100:00100000:0.0:1788201189.255026:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614083840 00000100:00100000:0.0:1788201189.255171:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 123 00000100:00100000:0.0:1788201189.255185:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+61:10535:x1875064614083840:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788201189.255369:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+61:10535:x1875064614083840:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 186us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201189.255377:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 123 00000100:00100000:3.0:1788201189.257640:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201189.257709:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614083968 00000100:00100000:0.0:1788201189.257721:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614083968 00000100:00100000:0.0:1788201189.257824:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:0.0:1788201189.257836:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+10:10535:x1875064614083968:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201189.257883:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201189.257909:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2bb7733/0x72011f792b787384 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2ef8 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.257954:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008808c783/0x72011f792b78737d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef1 expref: 11 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.257966:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201189.257973:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201189.257979:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2bb7733/0x72011f792b787384 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef8 expref: 11 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.258024:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008808c783/0x72011f792b78737d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef1 expref: 11 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.259196:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008808c783/0x72011f792b78737d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef1 expref: 11 pid: 6678 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201189.259233:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00066df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875064622480128:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788201189.259398:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005f0b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201189.262072:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201189.262238:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614084096 00000100:00100000:1.0:1788201189.262255:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614084096 00010000:00010000:1.0:1788201189.262303:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008808c783/0x72011f792b78737d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef1 expref: 12 pid: 6678 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.262348:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 55 00000100:00100000:1.0:1788201189.262369:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f612d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+12:2349:x1875064614084096:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201189.262385:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201189.262412:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008808c783/0x72011f792b78737d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef1 expref: 12 pid: 6678 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.262427:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008808c783/0x72011f792b78737d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef1 expref: 12 pid: 6678 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.262453:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201189.262457:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201189.262465:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2bb7733/0x72011f792b787384 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef8 expref: 12 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.262475:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2bb7733/0x72011f792b787384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef8 expref: 12 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.262513:0:5813:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d2bb7733/0x72011f792b787384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef8 expref: 12 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.262526:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5813:1875064622480256:192.168.203.14@tcp:105: 00000100:00100000:1.0:1788201189.262619:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00104f8540 going to sleep for 11 seconds 00010000:00010000:0.0:1788201189.262815:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008808c783/0x72011f792b78737d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef1 expref: 12 pid: 6678 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201189.262841:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00066df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875064622480128:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788201189.262877:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2bb7733/0x72011f792b787384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef8 expref: 11 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.262905:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676ec00, rc 0) 00000100:00100000:0.0:1788201189.262954:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+11:10535:x1875064614083968:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 5120us (5327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201189.262964:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:1.0:1788201189.267076:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5813:1875064622480256:192.168.203.14@tcp:105: 00010000:00010000:1.0:1788201189.267111:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201189.267196:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f612d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+10:2349:x1875064614084096:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 4826us (5136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.267223:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 55 00000100:00100000:3.0:1788201189.267478:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201189.267531:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614084224 00000100:00100000:0.0:1788201189.267542:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614084224 00002000:00100000:0.0:1788201189.267615:0:6681:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b003f611880 x1875064614084224/t0(0) o4->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:310/0 lens 504/0 e 0 to 0 dl 1788201200 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201189.267629:0:6681:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b003f611880 with x1875064614084224 ext(0->12) 00002000:00010000:0.0:1788201189.267637:0:6681:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b003f611880 00000100:00100000:0.0:1788201189.268173:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:0.0:1788201189.268186:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+10:2349:x1875064614084224:12345-192.168.203.14@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788201189.269269:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+12:2349:x1875064614084224:12345-192.168.203.14@tcp:4:lhsmtool_posix.0 Request processed in 1078us (1792us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788201189.269281:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 2 00002000:00100000:0.0:1788201189.269294:0:6681:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b003f611880 x1875064614084224/t4294967308(0) o4->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:310/0 lens 504/448 e 0 to 0 dl 1788201200 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201189.269306:0:6681:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b003f611880 with x1875064614084224 ext(0->12) 00002000:00010000:0.0:1788201189.269312:0:6681:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b003f611880 00000100:00100000:3.0:1788201189.271602:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201189.271969:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614084352 00000100:00100000:2.0:1788201189.271983:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614084352 00000100:00100000:2.0:1788201189.272054:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 124 00000100:00100000:2.0:1788201189.272066:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+61:10535:x1875064614084352:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788201189.322302:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+61:10535:x1875064614084352:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 Request processed in 50220us (50694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201189.322341:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 124 00000001:00080000:0.0:1788201189.322506:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1788201189.322529:0:5849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788201189.322568:0:5849:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9aff01b6ba80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788201189.322573:0:5849:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b0011f35400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9aff01b6bf00 00000020:00080000:0.0:1788201189.322584:0:5849:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b0011f35600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b0040406000 00000001:00080000:0.0:1788201189.322604:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:0.0:1788201189.322660:0:5849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788201189.322677:0:5849:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b003fa6f240 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788201189.322681:0:5849:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b0007145d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b003fa6fd80 00000020:00080000:0.0:1788201189.322685:0:5849:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b0007145f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b003fdffc00 00000020:00080000:0.0:1788201189.322751:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788201189.325278:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788201189.325711:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201189.325737:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622480384:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201189.326209:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201189.326297:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622480512:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201189.326328:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201189.326374:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622480384 00000100:00100000:3.0:1788201189.326383:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622480384 00000100:00100000:3.0:1788201189.326450:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622480512 00000100:00100000:3.0:1788201189.326454:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622480512 00000100:00100000:1.0:1788201189.326491:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201189.326505:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1875064622480384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201189.326556:0:6675:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1788201189.326589:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097f86c76/0x72011f792b78738b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201189.327093:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201189.327105:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3292:x1875064622480512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201189.327124:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1788201189.327179:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a95c8e4, atime: 0x6a95c8e4, ctime: 0x6a95c8e4, blocks: 0x1 00010000:00010000:2.0:1788201189.327188:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b787392 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.327202:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=268s v=(0 0) 00010000:00010000:2.0:1788201189.327208:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201189.327213:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b78714d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e57 expref: 11 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.327217:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b787392 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.327238:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788201189.327243:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201189.327248:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b787392 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.327249:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097f86c76/0x72011f792b78738b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.327273:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b787392 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.327284:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b787392 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.327308:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201189.327417:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b78714d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e57 expref: 11 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.327436:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b78714d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e57 expref: 11 pid: 7765 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.327453:0:6675:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6675:1875064622480640:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201189.327551:0:6675:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00104f8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201189.329032:0:7765:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788201189.329054:0:7765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00080000:3.0:1788201189.329101:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201189.330107:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201189.330123:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b787392 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.330154:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0000 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201189.330171:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b787392 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.330183:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b787392 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.330209:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b787392 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.330218:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ff863a8/0x72011f792b787392 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.330245:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201189.330267:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201189.330269:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201189.330632:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3292:x1875064622480512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3523us (4296us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788201189.330654:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1788201189.331848:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b003f610380/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788201189.331863:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622480512:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201189.332918:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201189.333723:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614084480 00000100:00100000:3.0:1788201189.333736:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614084480 00000100:00100000:3.0:1788201189.334219:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:3.0:1788201189.334233:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+12:2349:x1875064614084480:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788201189.334757:0:6675:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6675:1875064622480640:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201189.334795:0:6675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000097f86c76/0x72011f792b78738b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201189.334822:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201189.335227:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614084608 00000100:00100000:1.0:1788201189.335234:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614084608 00010000:00010000:1.0:1788201189.335270:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b78714d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e57 expref: 13 pid: 7765 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.335305:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 56 00000100:00100000:1.0:1788201189.335326:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:2349:x1875064614084608:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201189.335342:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201189.335351:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b78714d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e57 expref: 13 pid: 7765 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.335367:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b78714d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e57 expref: 13 pid: 7765 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.335401:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b78714d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e57 expref: 13 pid: 7765 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.335425:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201189.335431:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201189.335439:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000097f86c76/0x72011f792b78738b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.335481:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097f86c76/0x72011f792b78738b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.335516:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201189.335600:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+12:2349:x1875064614084608:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 275us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.335609:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 56 00010000:00010000:1.0:1788201189.335648:0:6675:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000097f86c76/0x72011f792b78738b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.335659:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097f86c76/0x72011f792b78738b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.335671:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097f86c76/0x72011f792b78738b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.335680:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097f86c76/0x72011f792b78738b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.335701:0:6675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201189.335755:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201189.335766:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097f86c76/0x72011f792b78738b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.335778:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fdc00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:2.0:1788201189.335783:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097f86c76/0x72011f792b78738b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.335794:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097f86c76/0x72011f792b78738b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.335821:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097f86c76/0x72011f792b78738b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.335829:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097f86c76/0x72011f792b78738b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.335854:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201189.335857:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201189.335859:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201189.336482:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3294:x1875064622480384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9977us (10270us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788201189.336494:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:2.0:1788201189.338376:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b003f612300/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788201189.338404:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622480384:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201189.360175:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+11:2349:x1875064614084480:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 Request processed in 25902us (27220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201189.360192:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 42 00000001:00080000:2.0:1788201189.360238:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1788201189.360257:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:2.0:1788201189.364282:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201189.364587:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614084864 00000100:00100000:0.0:1788201189.364601:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614084864 00000100:00100000:0.0:1788201189.364679:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 125 00000100:00100000:0.0:1788201189.364691:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:10535:x1875064614084864:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788201189.364769:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201189.364815:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787376 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eea expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.364841:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:0.0:1788201189.364847:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201189.364890:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b787399 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.364907:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b787399 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.365072:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b787399 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201189.365395:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000946b4c19 reply state 00000000bcf924e0 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b787399 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201189.365406:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201189.365539:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+16:10535:x1875064614084864:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 850us (1268us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1788201189.365547:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 125 00010000:00010000:0.0:1788201189.366954:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b787399 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.366996:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b787399 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.367005:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b787399 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.367012:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676e400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201189.367017:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b787399 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.367026:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b787399 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.367044:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:0.0:1788201189.367047:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201189.367053:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b787399 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.367060:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b787399 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201189.367658:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201189.367723:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614084992 00000100:00100000:1.0:1788201189.367734:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614084992 00000100:00100000:1.0:1788201189.367823:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:1.0:1788201189.367835:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0008849050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614084992:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788201189.368111:0:7765:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788201189.368115:0:7765:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788201188 00002000:00010000:1.0:1788201189.368118:0:7765:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788201188 00002000:00010000:1.0:1788201189.368120:0:7765:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788201189 -> 1788201188 00002000:00010000:1.0:1788201189.368122:0:7765:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788201189.368219:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0008849050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2349:x1875064614084992:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 386us (638us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788201189.368227:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:2.0:1788201189.370048:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201189.370097:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614085248 00000100:00100000:3.0:1788201189.370108:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614085248 00000100:00100000:3.0:1788201189.370207:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 126 00000100:00100000:3.0:1788201189.370218:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:10535:x1875064614085248:12345-192.168.203.14@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788201189.370381:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7873a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.370400:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78735a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2edc expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.370407:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7873a0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.370445:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78735a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2edc expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.370523:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78735a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2edc expref: 15 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201189.370538:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035fa0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5828:1875064622480768:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788201189.370865:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8c1240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201189.373259:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035fa0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5828:1875064622480768:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788201189.373309:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7873a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201189.373645:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201189.373839:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614085376 00000100:00100000:3.0:1788201189.373848:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614085376 00010000:00010000:3.0:1788201189.373892:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78735a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2edc expref: 16 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.373941:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:3.0:1788201189.373973:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+16:2348:x1875064614085376:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201189.373991:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201189.373999:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78735a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2edc expref: 16 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.374015:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78735a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2edc expref: 16 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.374043:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78735a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2edc expref: 16 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.374063:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:3.0:1788201189.374069:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7873a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.374080:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7873a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.374089:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7873a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.374263:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201189.374330:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:2348:x1875064614085376:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 360us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201189.374339:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 57 00010000:00010000:2.0:1788201189.374380:0:5828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7873a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.374399:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7873a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.374436:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7873a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.374443:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7873a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.374451:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7873a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.374458:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201189.374464:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7873a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.374473:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7873a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.374484:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:2.0:1788201189.374487:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788201189.374492:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7873a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.374499:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7873a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201189.374638:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:10535:x1875064614085248:12345-192.168.203.14@tcp:55:lhsmtool_posix.0 Request processed in 4421us (4600us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788201189.374647:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 126 00000100:00100000:2.0:1788201189.376295:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201189.376383:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614085504 00000100:00100000:0.0:1788201189.376394:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614085504 00000100:00100000:0.0:1788201189.376450:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:0.0:1788201189.376463:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2349:x1875064614085504:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788201189.376535:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b8ac13b/0x72011f792b7873a7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.376561:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2bb7733/0x72011f792b787384 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef8 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.376571:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201189.376576:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788201189.376581:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b8ac13b/0x72011f792b7873a7 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.376631:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d2bb7733/0x72011f792b787384 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef8 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.376647:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d2bb7733/0x72011f792b787384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef8 expref: 7 pid: 6677 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201189.376677:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00066df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6678:1875064622480896:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788201189.377736:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010d5c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201189.378719:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00066df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6678:1875064622480896:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788201189.378755:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007b8ac13b/0x72011f792b7873a7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201189.382078:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201189.383127:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614085632 00000100:00100000:3.0:1788201189.383228:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614085632 00010000:00010000:3.0:1788201189.383298:0:6691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d2bb7733/0x72011f792b787384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef8 expref: 8 pid: 6677 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.383474:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 58 00000100:00100000:3.0:1788201189.383486:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2349:x1875064614085632:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201189.383512:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201189.383551:0:6691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d2bb7733/0x72011f792b787384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef8 expref: 8 pid: 6677 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.383564:0:6691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d2bb7733/0x72011f792b787384 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef8 expref: 8 pid: 6677 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.383588:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2bb7733/0x72011f792b787384 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ef8 expref: 8 pid: 6677 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.383609:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201189.383614:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201189.383621:0:6691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007b8ac13b/0x72011f792b7873a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.383633:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b8ac13b/0x72011f792b7873a7 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.383672:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201189.383695:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007b8ac13b/0x72011f792b7873a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.383709:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b8ac13b/0x72011f792b7873a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.383745:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b8ac13b/0x72011f792b7873a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.383756:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b8ac13b/0x72011f792b7873a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.383757:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2349:x1875064614085632:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 271us (1690us total) trans 0 rc 0/0 00010000:00010000:2.0:1788201189.383771:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b8ac13b/0x72011f792b7873a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.383782:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 58 00010000:00010000:2.0:1788201189.383784:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f000 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:2.0:1788201189.383790:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8ac13b/0x72011f792b7873a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.384177:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8ac13b/0x72011f792b7873a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.384202:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b8ac13b/0x72011f792b7873a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.384211:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b8ac13b/0x72011f792b7873a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201189.384291:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614085504:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 Request processed in 7821us (7995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201189.384301:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:2.0:1788201189.388215:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201189.388375:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614085888 00000100:00100000:0.0:1788201189.388388:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614085888 00000100:00100000:0.0:1788201189.388462:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 127 00000100:00100000:0.0:1788201189.388476:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:10535:x1875064614085888:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788201189.388583:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b7873ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.388628:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b7873ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201189.388643:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b7873ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.389489:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7873b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.389509:0:9471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787368 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ee3 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.389519:0:9471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7873b5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.389568:0:9471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787368 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ee3 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.389588:0:9471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787368 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ee3 expref: 15 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.396394:0:9471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9471:1875064622481024:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201189.396527:0:9471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00104f8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201189.401864:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201189.401882:0:9471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9471:1875064622481024:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201189.401958:0:9471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7873b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201189.402182:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614086016 00000100:00100000:2.0:1788201189.402194:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614086016 00010000:00010000:2.0:1788201189.402247:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787368 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ee3 expref: 16 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201189.402309:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:2.0:1788201189.402330:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+16:2349:x1875064614086016:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201189.402351:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201189.402359:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787368 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ee3 expref: 16 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.402373:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787368 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ee3 expref: 16 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.402402:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787368 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ee3 expref: 16 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.402431:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:2.0:1788201189.402439:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7873b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.402452:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7873b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.402461:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7873b5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.402497:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201189.402588:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:2349:x1875064614086016:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 268us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201189.402597:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 59 00010000:00010000:1.0:1788201189.402824:0:9471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7873b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.402833:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7873b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201189.403088:0:9471:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1788201189.403769:0:9471:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1788201189.403835:0:9471:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1788201189.403940:0:9471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9471:1875064622481152:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788201189.404734:0:9471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201189.404831:0:9471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00104f8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201189.404905:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622481152 00000100:00100000:2.0:1788201189.404915:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622481152 00000100:00100000:2.0:1788201189.404970:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201189.404979:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788201189.404983:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9471:x1875064622481152:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788201189.404990:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788201189.405773:0:9471:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1788201189.405782:0:9471:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:3.0:1788201189.405824:0:9471:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b003f612300 x1875064622480384/t4294967309(4294967309) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201205 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201189.405840:0:9471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9471:1875064622481152:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788201189.406107:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9471:x1875064622481152:12345-0@lo:1000:mdt00_003.0 Request processed in 1125us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201189.406117:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000001:00080000:3.0:1788201189.406360:0:9471:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1788201189.406433:0:9471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f611c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9471:1875064622481280:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788201189.406487:0:9471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201189.406506:0:9471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0006315e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201189.406521:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622481280 00000100:00100000:1.0:1788201189.406639:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622481280 00000100:00100000:1.0:1788201189.406708:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201189.406719:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9471:x1875064622481280:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788201189.406951:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9471:x1875064622481280:12345-0@lo:1000:mdt00_003.0 Request processed in 234us (462us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788201189.406959:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201189.407007:0:9471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f611c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9471:1875064622481280:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788201189.407049:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7873b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.407061:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7873b5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.407070:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7873b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.407077:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fcc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201189.407083:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7873b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.407092:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7873b5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.407117:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:3.0:1788201189.407127:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201189.407149:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7873b5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.407155:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7873b5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.407189:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7872f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.407197:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7872f8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.407204:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7872f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.407210:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201189.407214:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7872f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.407224:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7872f8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.407235:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:3.0:1788201189.407237:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201189.407245:0:9471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7872ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ec7 expref: 18 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.407257:0:9471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7872ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ec7 expref: 18 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.407266:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7872ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ec7 expref: 18 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.407305:0:9471:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7872ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ec7 expref: 18 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.407319:0:9471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f612680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9471:1875064622481408:192.168.203.14@tcp:105: 00000100:00100000:3.0:1788201189.407402:0:9471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0006315e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201189.409168:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201189.409392:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614086144 00000100:00100000:2.0:1788201189.409412:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614086144 00000100:00100000:3.0:1788201189.409599:0:9471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f612680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9471:1875064622481408:192.168.203.14@tcp:105: 00000100:00100000:2.0:1788201189.409633:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 31 00010000:00010000:3.0:1788201189.409642:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7872f8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201189.409649:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:10534:x1875064614086144:12345-192.168.203.14@tcp:49:lfs.0 00010000:00010000:3.0:1788201189.409659:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7872f8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.409700:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b7873bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.409717:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b7873bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.409729:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b7873bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.409741:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b7873bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.409749:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b7873bc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.409758:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b7873bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.409787:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201189.409792:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b7873bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.409815:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b7873bc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.409830:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00000100:00100000:2.0:1788201189.409833:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:10534:x1875064614086144:12345-192.168.203.14@tcp:49:lfs.0 Request processed in 187us (698us total) trans 0 rc 0/0 00010000:00010000:3.0:1788201189.409835:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201189.409841:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b7873bc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.409850:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b7873bc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201189.409859:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 31 00010000:00010000:3.0:1788201189.409868:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b7873ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.409875:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b7873ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.409882:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b7873ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.409888:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676e000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201189.409891:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b7873ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.409899:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b7873ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.409921:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:3.0:1788201189.409924:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788201189.409928:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b7873ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.409935:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b7873ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201189.410214:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+18:10535:x1875064614085888:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 21741us (22014us total) trans 4294967407 rc 0/0 00000100:00100000:3.0:1788201189.410224:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 127 00000020:00080000:3.0:1788201189.410229:0:9471:0:(tgt_main.c:807:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788201189.410375:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788201189.410381:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201189.410917:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788201189.410927:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788201189.413822:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201189.414080:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614086400 00000100:00100000:2.0:1788201189.414092:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614086400 00000100:00100000:2.0:1788201189.414206:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 128 00000100:00100000:2.0:1788201189.414219:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+18:10534:x1875064614086400:12345-192.168.203.14@tcp:58:lfs.0 00000040:00080000:2.0:1788201189.414757:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788201189.414871:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+18:10534:x1875064614086400:12345-192.168.203.14@tcp:58:lfs.0 Request processed in 654us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201189.414880:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 128 00000100:00100000:3.0:1788201189.416733:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201189.416963:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614086656 00000100:00100000:2.0:1788201189.416975:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614086656 00000100:00100000:2.0:1788201189.417037:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:2.0:1788201189.417049:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002289e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+18:10535:x1875064614086656:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788201189.418518:0:5830:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788201189.418735:0:5830:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:2.0:1788201189.418819:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7873c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.418841:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7873c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.418857:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7873c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.418878:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7873c3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.418883:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7873c3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.418888:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7873c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.418908:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201189.419034:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002289e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:10535:x1875064614086656:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 1982us (2315us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788201189.419046:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 32 00000020:00080000:2.0:1788201189.419053:0:5830:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788201189.419340:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201189.419350:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7873c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.419361:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1200 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201189.419367:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7873c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.419377:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7873c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.419394:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b0011cb3300) 00010000:00010000:3.0:1788201189.419397:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201189.419402:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7873c3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.419408:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7873c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201189.419447:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201189.419449:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201189.419451:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201189.445201:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201189.445325:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614086784 00000100:00100000:2.0:1788201189.445339:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614086784 00000100:00100000:2.0:1788201189.445418:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 129 00000100:00100000:2.0:1788201189.445430:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:10537:x1875064614086784:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788201189.445469:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201189.445495:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b7873ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2eff expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.445581:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7873d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.445598:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7873d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.445611:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7873d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.445646:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.445658:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.445664:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.446033:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7873df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.446043:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7872ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ec0 expref: 21 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.446050:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7873df lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.446085:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7872ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ec0 expref: 21 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.446097:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7872ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ec0 expref: 21 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201189.446110:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035fa1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5829:1875064622481536:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788201189.446251:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8c16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201189.450334:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035fa1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5829:1875064622481536:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788201189.450342:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00010000:00010000:2.0:1788201189.450376:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7873df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.450468:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614087040 00000100:00100000:1.0:1788201189.450478:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614087040 00000100:00100000:1.0:1788201189.450541:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:1.0:1788201189.450552:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:5586:x1875064614087040:12345-192.168.203.14@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788201189.450899:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+23:5586:x1875064614087040:12345-192.168.203.14@tcp:35:ldlm_bl.0 Request processed in 348us (625us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788201189.450914:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:0.0:1788201189.455941:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201189.456392:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614087168 00000100:00100000:1.0:1788201189.456406:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614087168 00010000:00010000:1.0:1788201189.456459:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7872ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ec0 expref: 23 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201189.456550:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:1.0:1788201189.456564:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006798c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+23:2349:x1875064614087168:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201189.456586:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201189.456596:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7872ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ec0 expref: 23 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.456612:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7872ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ec0 expref: 23 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.456642:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7872ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ec0 expref: 23 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.456665:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:1.0:1788201189.456672:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7873df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.456683:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7873df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.456692:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7873df lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201189.456748:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201189.456890:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7873df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.456897:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7873df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201189.456950:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788201189.456954:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201189.456974:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7873df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.456985:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7873df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.456995:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7873d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.457000:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7873d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.457005:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7873d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.457010:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201189.457013:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7873d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.457018:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7873d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.457025:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:2.0:1788201189.457035:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201189.457039:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7873d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.457043:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7873d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.457057:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.457061:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.457065:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.457068:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201189.457069:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.457072:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.457076:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b0011cb3500) 00010000:00010000:2.0:1788201189.457078:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201189.457079:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.457082:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.457119:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b7873ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eff expref: 23 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.457183:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7873df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eff expref: 22 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201189.457191:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:2.0:1788201189.457194:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201189.457196:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1800, rc 0) 00000100:00100000:1.0:1788201189.457266:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006798c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:2349:x1875064614087168:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 703us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201189.457275:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:2.0:1788201189.457398:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:10537:x1875064614086784:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 11970us (12262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201189.457407:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 129 00010000:00010000:1.0:1788201189.837410:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201190.156695:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622482048:0@lo:400:kworker.0 00000100:00100000:2.0:1788201190.156771:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201190.156782:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622481664:0@lo:400:kworker.0 00000100:00100000:1.0:1788201190.156827:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201190.156851:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622481792:0@lo:400:kworker.0 00000100:00100000:1.0:1788201190.156851:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035fa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622482176:0@lo:400:kworker.0 00000100:00100000:1.0:1788201190.156875:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201190.156879:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035fa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622481920:0@lo:400:kworker.0 00000100:00100000:2.0:1788201190.156900:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201190.156907:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622481664 00000100:00100000:1.0:1788201190.156914:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622481664 00000100:00100000:2.0:1788201190.156928:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622482048 00000100:00100000:2.0:1788201190.156932:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622482048 00000100:00100000:2.0:1788201190.156960:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788201190.156960:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788201190.156968:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3292:x1875064622482048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201190.156968:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622481664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201190.157015:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3292:x1875064622482048:12345-0@lo:400:kworker.0 Request processed in 47us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201190.157015:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3293:x1875064622481664:12345-0@lo:400:kworker.0 Request processed in 47us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201190.157022:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788201190.157022:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788201190.157043:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622482176 00000100:00100000:2.0:1788201190.157047:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622482176 00000100:00100000:1.0:1788201190.157063:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622481664:0@lo:400:kworker.0 00000100:00100000:2.0:1788201190.157075:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622481920 00000100:00100000:2.0:1788201190.157077:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622481920 00000100:00100000:2.0:1788201190.157106:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788201190.157112:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622482176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201190.157186:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622482176:12345-0@lo:400:kworker.0 Request processed in 74us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201190.157192:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788201190.157205:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788201190.157211:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622481920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201190.157240:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622481920:12345-0@lo:400:kworker.0 Request processed in 30us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201190.157245:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1788201190.157262:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201190.157330:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035fa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622482176:0@lo:400:kworker.0 00000100:00100000:2.0:1788201190.157508:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201190.157538:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622482304:0@lo:400:kworker.0 00000100:00100000:2.0:1788201190.157563:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201190.157591:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622482304 00000100:00100000:2.0:1788201190.157595:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622482304 00000100:00100000:2.0:1788201190.157622:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788201190.157629:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3294:x1875064622482304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201190.157662:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3294:x1875064622482304:12345-0@lo:400:kworker.0 Request processed in 34us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201190.157669:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788201190.157684:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201190.157701:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035fa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622481920:0@lo:400:kworker.0 00000100:00100000:2.0:1788201190.157723:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622482304:0@lo:400:kworker.0 00000100:00100000:2.0:1788201190.157753:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622482048:0@lo:400:kworker.0 00000100:00100000:1.0:1788201190.159011:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622481792 00000100:00100000:1.0:1788201190.159020:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622481792 00000100:00100000:1.0:1788201190.159061:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788201190.159069:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622481792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201190.159131:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622481792:12345-0@lo:400:kworker.0 Request processed in 62us (1622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201190.159167:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788201190.159349:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622481792:0@lo:400:kworker.0 00000100:00100000:1.0:1788201190.163931:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201190.163953:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622482432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201190.164013:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201190.164064:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622482432 00000100:00100000:3.0:1788201190.164073:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622482432 00000100:00100000:3.0:1788201190.164129:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788201190.164156:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1875064622482432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201190.164189:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201190.164252:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1875064622482432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201190.164260:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788201190.164302:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622482432:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788201190.209709:0:12105:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788201190.209720:0:12105:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788201190.209768:0:12105:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788201190.209774:0:12105:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788201190.412394:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788201190.412401:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201190.412456:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788201190.412465:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788201190.412598:0:11684:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035fa1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875064622482560:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788201190.412687:0:11684:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8c1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201190.429014:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201190.429252:0:11684:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035fa1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875064622482560:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788201190.433406:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614087296 00000100:00100000:0.0:1788201190.433420:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614087296 00000100:00100000:0.0:1788201190.433485:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 130 00000100:00100000:0.0:1788201190.433495:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:10549:x1875064614087296:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788201190.433540:0:9471:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788201190.433651:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:10549:x1875064614087296:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 157us (4646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201190.433659:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 130 00000100:00100000:3.0:1788201190.455803:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201190.456158:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614087552 00000100:00100000:1.0:1788201190.456169:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614087552 00000100:00100000:1.0:1788201190.456230:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 131 00000100:00100000:1.0:1788201190.456242:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:10549:x1875064614087552:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201190.456266:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201190.456290:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b7873e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f06 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201190.456495:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b7873ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201190.456514:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b7873ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201190.456542:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b7873ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201190.456556:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788201190.457074:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b7873e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f06 expref: 24 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201190.457093:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b7873ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f06 expref: 23 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201190.457118:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:1.0:1788201190.457122:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201190.457125:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fdc00, rc 0) 00000100:00100000:1.0:1788201190.457273:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+23:10549:x1875064614087552:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 1033us (1487us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788201190.457280:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 131 00000100:00100000:0.0:1788201190.464886:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201190.465002:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614087680 00000100:00100000:1.0:1788201190.465013:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614087680 00000100:00100000:1.0:1788201190.465074:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:1.0:1788201190.465084:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+23:2348:x1875064614087680:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201190.465101:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201190.465153:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b7873ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f06 expref: 23 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201190.465173:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:1.0:1788201190.465178:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201190.465232:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:2348:x1875064614087680:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 149us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201190.465240:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:0.0:1788201190.491817:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201190.494040:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614087936 00000100:00100000:2.0:1788201190.494054:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614087936 00000100:00100000:2.0:1788201190.494127:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 132 00000100:00100000:2.0:1788201190.494175:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:10549:x1875064614087936:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788201190.494268:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201190.494287:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201190.494298:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201190.494487:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201190.494495:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201190.494519:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201190.494525:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201190.494530:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201190.494537:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201190.494549:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:2.0:1788201190.494553:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788201190.494557:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201190.494563:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7873fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201190.494737:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+23:10549:x1875064614087936:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 564us (2928us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788201190.494763:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 132 00000040:00080000:3.0:1788201190.494817:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788201190.494822:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788201190.495336:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788201190.495345:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788201190.499778:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201190.500022:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614088192 00000100:00100000:2.0:1788201190.500035:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614088192 00000100:00100000:2.0:1788201190.500188:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:2.0:1788201190.500202:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+23:10549:x1875064614088192:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788201190.500554:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+24:10549:x1875064614088192:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 354us (792us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788201190.500563:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 34 00010000:00010000:0.0:1788201190.859606:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201191.180296:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:2.0:1788201191.180546:0:7209:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 270305410737ns, next at 271305407422ns, rc = 0 00000100:00100000:1.0:1788201191.186889:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622482688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201191.186996:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201191.187404:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622482688 00000100:00100000:3.0:1788201191.187416:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622482688 00000100:00100000:3.0:1788201191.187800:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201191.187813:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1875064622482688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201191.187882:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788201191.188048:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201191.188188:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1875064622482688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 378us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201191.188196:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788201191.192590:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622482688:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788201191.887348:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788201192.462785:0:12156:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788201192.462798:0:12156:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788201192.462856:0:12156:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788201192.462863:0:12156:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788201192.570110:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201192.570199:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614088448 00000100:00100000:3.0:1788201192.570211:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614088448 00000100:00100000:3.0:1788201192.570292:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 133 00000100:00100000:3.0:1788201192.570304:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+24:10570:x1875064614088448:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788201192.570336:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201192.570362:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787402 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f0d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201192.570489:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787409 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201192.570508:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787409 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201192.570521:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787409 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201192.570535:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788201192.570692:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787402 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f0d expref: 27 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201192.570729:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787409 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f0d expref: 26 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201192.570740:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:3.0:1788201192.570743:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788201192.570747:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c7000, rc 0) 00000100:00100000:3.0:1788201192.570831:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:10570:x1875064614088448:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 529us (733us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788201192.570838:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 133 00000100:00080000:3.0:1788201192.570865:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201192.574466:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201192.574579:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614088576 00000100:00100000:1.0:1788201192.574592:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614088576 00000100:00100000:1.0:1788201192.574672:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 134 00000100:00100000:1.0:1788201192.574685:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:10570:x1875064614088576:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:1.0:1788201192.574787:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b787417 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.574809:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b787417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.574821:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b787417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.574858:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b787417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.574865:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b787417 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.574872:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b787417 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.574879:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fcc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201192.574884:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b787417 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.574893:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b787417 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.574906:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:1.0:1788201192.574909:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201192.574914:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b787417 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201192.574931:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b787417 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201192.575032:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:10570:x1875064614088576:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 349us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201192.575040:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 134 00000100:00100000:1.0:1788201192.646615:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201192.646966:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614088704 00000100:00100000:2.0:1788201192.646977:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614088704 00000100:00100000:2.0:1788201192.647187:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:2.0:1788201192.647198:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614088704:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:2.0:1788201192.647218:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201192.647239:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061a41cd1/0x72011f792b78741e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f14 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201192.647265:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a95c8e4, atime: 0x6a95c8e4, ctime: 0x6a95c8e4, blocks: 0xb 00010000:00010000:2.0:1788201192.647285:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=271s v=(0 0) 00010000:00010000:2.0:1788201192.647289:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201192.647299:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061a41cd1/0x72011f792b78741e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f14 expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201192.647316:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061a41cd1/0x72011f792b78741e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f14 expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201192.647344:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1000, rc 0) 00000100:00100000:2.0:1788201192.647404:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2349:x1875064614088704:12345-192.168.203.14@tcp:101:cat.0 Request processed in 208us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201192.647411:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00080000:3.0:1788201192.647861:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201192.657300:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201192.657556:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614088832 00000100:00100000:0.0:1788201192.657571:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614088832 00002000:00100000:0.0:1788201192.657633:0:6683:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9b003f610000 x1875064614088832/t0(0) o3->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:313/0 lens 488/0 e 0 to 0 dl 1788201203 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201192.657659:0:6683:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b003f610000 with x1875064614088832 ext(0->4095) 00002000:00010000:0.0:1788201192.657665:0:6683:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b003f610000 00000100:00100000:0.0:1788201192.657704:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:0.0:1788201192.657715:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2348:x1875064614088832:12345-192.168.203.14@tcp:3:cat.0 00000100:00100000:0.0:1788201192.657991:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2348:x1875064614088832:12345-192.168.203.14@tcp:3:cat.0 Request processed in 278us (705us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788201192.658000:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00002000:00100000:0.0:1788201192.658007:0:6683:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9b003f610000 x1875064614088832/t0(0) o3->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:313/0 lens 488/4536 e 0 to 0 dl 1788201203 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201192.658015:0:6683:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b003f610000 with x1875064614088832 ext(0->4095) 00002000:00010000:0.0:1788201192.658018:0:6683:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b003f610000 00000001:00080000:2.0:1788201192.775283:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1788201192.775299:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1788201192.775307:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:3.0:1788201192.907296:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201193.935200:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201194.280485:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201194.281211:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201194.281236:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201194.282389:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201194.282426:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201194.282456:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614089472 00000100:00100000:3.0:1788201194.282465:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614089472 00000100:00100000:3.0:1788201194.282519:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614089088 00000100:00100000:3.0:1788201194.282522:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614089088 00000100:00100000:3.0:1788201194.282562:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 128 00000100:00100000:3.0:1788201194.282571:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2351:x1875064614089472:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201194.282643:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2351:x1875064614089472:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 73us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201194.282669:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 128 00000100:00100000:3.0:1788201194.282684:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 129 00000100:00100000:3.0:1788201194.282691:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:2351:x1875064614089088:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201194.282718:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:2351:x1875064614089088:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201194.282724:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 129 00000100:00100000:3.0:1788201194.282743:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614089216 00000100:00100000:3.0:1788201194.282746:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614089216 00000100:00100000:3.0:1788201194.282778:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614089344 00000100:00100000:3.0:1788201194.282781:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614089344 00000100:00100000:3.0:1788201194.282802:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:3.0:1788201194.282809:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2351:x1875064614089216:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201194.282835:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2351:x1875064614089216:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 27us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201194.282841:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:3.0:1788201194.282851:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:3.0:1788201194.282857:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2351:x1875064614089344:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201194.282880:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2351:x1875064614089344:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 23us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201194.282887:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00080000:3.0:1788201194.287736:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201194.287746:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201194.287749:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201194.287779:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614088960 00000100:00100000:3.0:1788201194.287789:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614088960 00000100:00100000:3.0:1788201194.287857:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 284 00000100:00100000:3.0:1788201194.287868:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2351:x1875064614088960:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201194.287944:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2351:x1875064614088960:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 78us (7467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201194.287953:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 284 00000001:00080000:2.0:1788201194.845250:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1788201194.845274:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1788201194.863792:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000020:00080000:0.0:1788201194.863813:0:5849:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1788201194.863826:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000004:00080000:0.0:1788201194.863839:0:5849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:0.0:1788201194.863850:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000001:00080000:0.0:1788201194.863868:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1788201194.863877:0:5849:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b0006315000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788201194.863882:0:5849:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b003b397f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b0006315480 00000020:00080000:0.0:1788201194.863885:0:5849:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b003b397000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b003fc55800 00000020:00080000:0.0:1788201194.863898:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000100:00100000:1.0:1788201194.865114:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622482816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788201194.865268:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201194.865383:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622482816 00000100:00100000:2.0:1788201194.865390:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622482816 00000100:00100000:2.0:1788201194.865445:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201194.865455:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622482816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788201194.865670:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788201194.865674:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788201188 -> 1788201188 00002000:00010000:2.0:1788201194.865677:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1788201188 -> 1788201188 00002000:00010000:2.0:1788201194.865679:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788201188 -> 1788201188 00002000:00010000:2.0:1788201194.865681:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788201194.865719:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1875064622482816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 265us (450us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788201194.865726:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788201194.865746:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201194.865814:0:3293:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1788201194.865820:0:3293:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b003f612300, transno 4294967309 00000004:00080000:1.0:1788201194.865838:0:3293:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:1.0:1788201194.865865:0:3293:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b0040906a00 x1875064622482816/t4294967312(4294967312) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788201210 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788201194.865876:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0040906a00/2, rc 0, transno 4294967312 00000100:00100000:1.0:1788201194.865881:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622482816:0@lo:2:osp-syn-0-0.0 00000020:00080000:0.0:1788201194.867255:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1788201194.955441:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201195.278208:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f39aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622482944:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.278278:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201195.278710:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201195.278717:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622483072:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.278747:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201195.278789:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622482944 00000100:00100000:0.0:1788201195.278796:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622482944 00000100:00100000:0.0:1788201195.278837:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788201195.278846:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622482944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.278893:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622482944:12345-0@lo:400:kworker.0 Request processed in 47us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201195.278900:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788201195.278942:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f39aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622482944:0@lo:400:kworker.0 00000100:00100000:3.0:1788201195.279155:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622483584:0@lo:400:kworker.0 00000100:00100000:3.0:1788201195.279184:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201195.279205:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201195.279210:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622483456:0@lo:400:kworker.0 00000100:00100000:3.0:1788201195.279229:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201195.279255:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622483072 00000100:00100000:3.0:1788201195.279258:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622483072 00000100:00100000:3.0:1788201195.279281:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622483456 00000100:00100000:3.0:1788201195.279284:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622483456 00000100:00100000:3.0:1788201195.279311:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788201195.279318:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622483072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201195.279349:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622483072:12345-0@lo:400:kworker.0 Request processed in 32us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201195.279355:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788201195.279416:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788201195.279423:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875064622483456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201195.279457:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875064622483456:12345-0@lo:400:kworker.0 Request processed in 34us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201195.279462:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788201195.279483:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f39aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622483200:0@lo:400:kworker.0 00000100:00100000:3.0:1788201195.279505:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201195.279532:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201195.279537:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622483328:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.279664:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622483072:0@lo:400:kworker.0 00000100:00100000:3.0:1788201195.279705:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201195.280520:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622483200 00000100:00100000:2.0:1788201195.280526:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622483200 00000100:00100000:2.0:1788201195.280569:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788201195.280578:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622483200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201195.280622:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622483200:12345-0@lo:400:kworker.0 Request processed in 46us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201195.280628:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1788201195.280645:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201195.285801:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622483584 00000100:00100000:0.0:1788201195.285814:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622483584 00000100:00100000:0.0:1788201195.285883:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622483328 00000100:00100000:0.0:1788201195.285887:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622483328 00000100:00100000:0.0:1788201195.285912:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201195.285921:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622483584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.286015:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622483584:12345-0@lo:400:kworker.0 Request processed in 95us (6829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201195.286022:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201195.286036:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788201195.286042:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3292:x1875064622483328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.286070:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3292:x1875064622483328:12345-0@lo:400:kworker.0 Request processed in 28us (6364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201195.286081:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788201195.286202:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201195.286283:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622483456:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.286293:0:3295:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788201195.286298:0:3295:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788201195.286318:0:3295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b003f610380, transno 4294967304 00000100:00100000:0.0:1788201195.286336:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622483584:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.286373:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622483712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201195.286407:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201195.286436:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622483328:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.286446:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f39aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622483200:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.286465:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622483712 00000100:00100000:0.0:1788201195.286468:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622483712 00000100:00100000:0.0:1788201195.286489:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201195.286494:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622483712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201195.286519:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201195.286546:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622483712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201195.286552:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201195.286588:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622483712:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788201195.979380:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201196.299457:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035fa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622483840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201196.299739:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201196.300407:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622483840 00000100:00100000:1.0:1788201196.300422:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622483840 00000100:00100000:1.0:1788201196.300513:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201196.300527:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1875064622483840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201196.300578:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201196.300678:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1875064622483840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201196.300685:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201196.300790:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035fa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622483840:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788201196.302161:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201197.003518:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201197.209372:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201197.209907:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614089600 00000100:00100000:3.0:1788201197.209921:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614089600 00000100:00100000:3.0:1788201197.210010:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 135 00000100:00100000:3.0:1788201197.210025:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:10214:x1875064614089600:12345-192.168.203.14@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788201197.210186:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:10214:x1875064614089600:12345-192.168.203.14@tcp:60:lhsmtool_posix.0 Request processed in 164us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201197.210194:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 135 00000100:00080000:3.0:1788201197.210218:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201197.214626:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201197.214752:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614089856 00000100:00100000:1.0:1788201197.214767:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614089856 00000100:00100000:1.0:1788201197.214842:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:1.0:1788201197.214859:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:10214:x1875064614089856:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788201197.215647:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:10214:x1875064614089856:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 790us (1031us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788201197.215658:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:3.0:1788201197.391569:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201197.392465:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614089984 00000100:00100000:2.0:1788201197.392481:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614089984 00000100:00100000:2.0:1788201197.392610:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 136 00000100:00100000:2.0:1788201197.392625:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:11021:x1875064614089984:12345-192.168.203.14@tcp:101:lsof.0 00010000:00010000:2.0:1788201197.392656:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201197.392894:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787425 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f1b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201197.392997:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78742c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201197.393025:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78742c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201197.393039:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78742c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788201197.393473:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788201197.394878:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788201197.394886:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201197.395421:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78742c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201197.395473:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787425 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f1b expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201197.395604:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78742c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f1b expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201197.395617:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00033b2000) 00010000:00010000:2.0:1788201197.395620:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201197.395624:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1600, rc 0) 00000100:00100000:2.0:1788201197.395869:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+6:11021:x1875064614089984:12345-192.168.203.14@tcp:101:lsof.0 Request processed in 3246us (4377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201197.395991:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 136 00000040:00080000:1.0:1788201197.643553:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788201197.643565:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788201197.643986:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788201197.643994:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788201198.028625:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201199.051402:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201199.388208:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201199.388252:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201199.388284:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201199.388308:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201199.388333:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201199.388361:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614090624 00000100:00100000:1.0:1788201199.388369:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614090624 00000100:00100000:1.0:1788201199.388427:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614090240 00000100:00100000:1.0:1788201199.388430:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614090240 00000100:00100000:1.0:1788201199.388453:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 133 00000100:00100000:1.0:1788201199.388464:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e1fa00b-ddbb-4133-8a19-496b22d710da+6:2349:x1875064614090624:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201199.388536:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e1fa00b-ddbb-4133-8a19-496b22d710da+6:2349:x1875064614090624:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 73us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201199.388555:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 133 00000100:00100000:1.0:1788201199.388575:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 134 00000100:00100000:1.0:1788201199.388581:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:2349:x1875064614090240:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201199.388615:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:2349:x1875064614090240:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 34us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201199.388621:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 134 00000100:00100000:1.0:1788201199.388642:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614090368 00000100:00100000:1.0:1788201199.388645:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614090368 00000100:00100000:1.0:1788201199.388669:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614090496 00000100:00100000:1.0:1788201199.388672:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614090496 00000100:00100000:1.0:1788201199.388691:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 64 00000100:00100000:3.0:1788201199.388837:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614090112 00000100:00100000:3.0:1788201199.388841:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614090112 00000100:00100000:3.0:1788201199.388871:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 286 00000100:00100000:3.0:1788201199.388878:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2349:x1875064614090112:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201199.388916:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2349:x1875064614090112:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 37us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201199.388925:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 286 00000100:00100000:1.0:1788201199.388987:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614090368:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201199.389018:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614090368:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 33us (765us total) trans 0 rc 0/0 00000100:00080000:2.0:1788201199.389279:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201199.389283:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201199.389286:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201199.393552:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 65 00000100:00100000:0.0:1788201199.393581:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2349:x1875064614090496:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201199.393701:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2349:x1875064614090496:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 127us (5359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201199.393711:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 65 00000100:00100000:1.0:1788201199.402030:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 64 00000020:00080000:0.0:1788201199.942262:0:5849:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1788201199.942301:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1788201199.942363:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788201199.942381:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:3.0:1788201199.952720:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:2.0:1788201200.083786:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201200.395371:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622484096:0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.395392:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622483968:0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.395417:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622484352:0@lo:400:kworker.0 00000100:00100000:3.0:1788201200.395456:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201200.395497:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.395518:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201200.395569:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622484608:0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.395578:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1875064622484480:0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.395730:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201200.395740:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1875064622484224:0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.395776:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201200.395818:0:12066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622484352 00000100:00100000:1.0:1788201200.395827:0:12066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622484352 00000100:00100000:1.0:1788201200.395902:0:12066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201200.395930:0:12066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622484352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.395998:0:12066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622484352:12345-0@lo:400:kworker.0 Request processed in 71us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.396006:0:12066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201200.396036:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622484096 00000100:00100000:1.0:1788201200.396040:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622484096 00000100:00100000:1.0:1788201200.396065:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622484224 00000100:00100000:1.0:1788201200.396068:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622484224 00000100:00100000:1.0:1788201200.396085:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788201200.396092:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622484096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.396125:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622484096:12345-0@lo:400:kworker.0 Request processed in 33us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.396156:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788201200.396172:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788201200.396183:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0027577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875064622484224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.396192:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201200.396229:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0027577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875064622484224:12345-0@lo:400:kworker.0 Request processed in 49us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.396237:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788201200.396243:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622483968 00000100:00100000:2.0:1788201200.396249:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622483968 00000100:00100000:1.0:1788201200.396250:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622484480 00000100:00100000:1.0:1788201200.396255:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622484480 00000100:00100000:1.0:1788201200.396279:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788201200.396285:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875064622484480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.396293:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788201200.396304:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622483968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201200.396325:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201200.396339:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875064622484480:12345-0@lo:400:kworker.0 Request processed in 50us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.396349:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788201200.396363:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622483968:12345-0@lo:400:kworker.0 Request processed in 58us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.396374:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788201200.396386:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622484608 00000100:00100000:1.0:1788201200.396390:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622484608 00000100:00100000:3.0:1788201200.396438:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622484096:0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.396438:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201200.396452:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622484608:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788201200.396989:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201200.396995:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201200.396998:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201200.397022:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622484736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201200.397059:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622483968:0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.397077:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1875064622484480:0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.397644:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622484608:12345-0@lo:400:kworker.0 Request processed in 1190us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.397655:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788201200.399887:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201200.401431:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1875064622484224:0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.401518:0:3293:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788201200.401526:0:3293:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0040906a00, transno 4294967312 00000100:00100000:1.0:1788201200.401547:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622484352:0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.401613:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622484608:0@lo:400:kworker.0 00000100:00100000:3.0:1788201200.401702:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622484736 00000100:00100000:3.0:1788201200.401717:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622484736 00000100:00100000:3.0:1788201200.401797:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788201200.401809:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622484736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201200.401849:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201200.401937:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622484736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201200.401949:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788201200.401990:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622484736:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788201200.647247:0:12358:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:33:19 (1788201199) 00010000:00010000:1.0:1788201201.101827:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201201.419835:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035fa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622484864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201201.419936:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201201.420106:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622484864 00000100:00100000:0.0:1788201201.420117:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622484864 00000100:00100000:0.0:1788201201.420212:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788201201.420224:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622484864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201201.420270:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201201.420341:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622484864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201201.420349:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788201201.420656:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035fa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622484864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201201.960041:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201201.960915:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614090880 00000100:00100000:2.0:1788201201.960929:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614090880 00000100:00100000:2.0:1788201201.961275:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 137 00000100:00100000:2.0:1788201201.961289:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00408e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:11286:x1875064614090880:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201201.961316:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201201.961353:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b787433 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f22 expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.962025:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78743a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.962046:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78743a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.962062:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78743a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.962092:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787441 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.962100:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787441 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.962108:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787441 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.962997:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787448 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.963014:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787448 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.963022:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787448 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201201.963048:0:9471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00000100:00080000:0.0:1788201201.967967:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201201.972822:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78743a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.972846:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78743a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.972855:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78743a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.972863:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201201.972869:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78743a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.972878:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78743a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.972902:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b00109a1100) 00010000:00010000:2.0:1788201201.972906:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201201.972912:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78743a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.972920:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78743a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.972940:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787441 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.972947:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787441 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.972996:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787441 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.973001:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201201.973004:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787441 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.973011:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787441 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.973020:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b0011cb3c00) 00010000:00010000:2.0:1788201201.973023:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201201.973026:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787441 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.973032:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787441 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.974470:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b787433 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f22 expref: 16 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.974498:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787448 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f22 expref: 15 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.974508:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b0011cb3e00) 00010000:00010000:2.0:1788201201.974510:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201201.974513:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1a00, rc 0) 00000100:00100000:2.0:1788201201.974624:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00408e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:11286:x1875064614090880:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 13337us (14595us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788201201.974645:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 137 00000100:00100000:3.0:1788201201.980800:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201201.981777:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201201.981982:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614091136 00000100:00100000:2.0:1788201201.981995:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614091136 00000100:00100000:2.0:1788201201.982112:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 138 00000100:00100000:2.0:1788201201.982124:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:11286:x1875064614091136:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788201201.982370:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:11286:x1875064614091136:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 Request processed in 249us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201201.982379:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 138 00000100:00100000:1.0:1788201201.982683:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614091008 00000100:00100000:1.0:1788201201.982693:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614091008 00000100:00100000:1.0:1788201201.982805:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:1.0:1788201201.982814:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:2348:x1875064614091008:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201201.982828:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201201.982863:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787448 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f22 expref: 15 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201201.982886:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b0011cb3e00) 00010000:00010000:1.0:1788201201.982909:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201201.982945:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:2348:x1875064614091008:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 133us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201201.982951:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00010000:00010000:1.0:1788201202.124262:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788201202.763573:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788201202.763583:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788201202.763621:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788201202.763627:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788201203.147620:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201203.736052:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201203.736092:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614091264 00000100:00100000:3.0:1788201203.736102:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614091264 00000100:00100000:3.0:1788201203.736187:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 139 00000100:00100000:3.0:1788201203.736197:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:11328:x1875064614091264:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788201203.736217:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201203.736236:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787456 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f29 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736316:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b78745d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736331:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b78745d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736343:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b78745d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736358:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b787464 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736365:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b787464 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736371:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b787464 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736631:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b78745d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736639:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b78745d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736646:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b78745d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736653:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201203.736657:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b78745d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736673:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b78745d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736684:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00033b2000) 00010000:00010000:3.0:1788201203.736687:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201203.736692:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b78745d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736708:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b78745d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736722:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b787464 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736728:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b787464 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736734:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b787464 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736739:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201203.736741:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b787464 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736747:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b787464 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736754:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b00109a1a00) 00010000:00010000:3.0:1788201203.736756:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201203.736759:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b787464 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736773:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b787464 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736804:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787456 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f29 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736814:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00033b2000) 00010000:00010000:3.0:1788201203.736816:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201203.736819:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787456 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f29 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.736828:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c7a00, rc 0) 00000100:00100000:3.0:1788201203.736883:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:11328:x1875064614091264:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 688us (841us total) trans 0 rc 301/301 00000100:00100000:3.0:1788201203.736890:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 139 00000100:00080000:3.0:1788201203.736913:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201203.741448:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201203.741555:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614091520 00000100:00100000:2.0:1788201203.741565:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614091520 00000100:00100000:2.0:1788201203.741627:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 140 00000100:00100000:2.0:1788201203.741637:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:11328:x1875064614091520:12345-192.168.203.14@tcp:36:lfs.0 00010000:00010000:2.0:1788201203.741692:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201203.741731:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b786dd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d62 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201203.741748:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00033b2000) 00010000:00010000:2.0:1788201203.741754:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201203.742026:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b78746b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201203.742041:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78742c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f1b expref: 5 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201203.742049:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b78746b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201203.742095:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78742c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f1b expref: 5 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201203.742107:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78742c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f1b expref: 5 pid: 5829 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201203.742122:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035fa3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5828:1875064622484992:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788201203.742336:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005efa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201203.755889:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201203.756172:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614091648 00000100:00100000:1.0:1788201203.756181:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614091648 00010000:00010000:1.0:1788201203.756231:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78742c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f1b expref: 6 pid: 5829 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201203.756267:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:1.0:1788201203.756278:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+6:2348:x1875064614091648:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201203.756293:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201203.756299:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78742c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f1b expref: 6 pid: 5829 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201203.756312:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78742c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f1b expref: 6 pid: 5829 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201203.756333:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00033b2000) 00010000:00010000:1.0:1788201203.756338:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b78746b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201203.756347:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b78746b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201203.756355:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b78746b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201203.756384:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201203.756432:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+6:2348:x1875064614091648:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 157us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201203.756439:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00080000:1.0:1788201203.757321:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788201203.765687:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78742c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f1b expref: 5 pid: 5829 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201203.765725:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035fa3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5828:1875064622484992:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788201203.765749:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b78746b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.765760:0:5828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b78746b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.765778:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b78746b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.765807:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787472 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.765820:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787472 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.765830:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787472 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201203.771675:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788201203.771707:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b78746b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.771719:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b78746b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.771726:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b78746b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.771733:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201203.771737:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b78746b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.771744:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b78746b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.771759:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00033b2000) 00010000:00010000:3.0:1788201203.771763:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201203.771774:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b78746b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.771781:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b78746b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201203.771801:0:5828:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079392ab1 reply state 00000000c19d3f23 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787472 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201203.771810:0:5828:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201203.771959:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:11328:x1875064614091520:12345-192.168.203.14@tcp:36:lfs.0 Request processed in 30319us (30515us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788201203.771968:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 140 00010000:00010000:2.0:1788201203.793746:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787472 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201203.793763:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787472 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201203.793771:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787472 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201203.793778:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201203.793782:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787472 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201203.793790:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787472 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201203.793806:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b00109a1a00) 00010000:00010000:2.0:1788201203.793810:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201203.793814:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787472 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201203.793833:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b787472 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201203.895190:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201203.895743:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614091776 00000100:00100000:3.0:1788201203.895754:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614091776 00000100:00100000:3.0:1788201203.895816:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 141 00000100:00100000:3.0:1788201203.895826:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:11336:x1875064614091776:12345-192.168.203.14@tcp:101:lctl.0 00010000:00010000:3.0:1788201203.895850:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201203.895873:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b787479 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f30 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.895935:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787480 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.895948:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.895960:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201203.896016:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788201203.896031:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201203.896064:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.896088:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b787479 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f30 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.896106:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f30 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.896115:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00109a1f00) 00010000:00010000:3.0:1788201203.896118:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201203.896121:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c7800, rc 0) 00000100:00100000:3.0:1788201203.896217:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:11336:x1875064614091776:12345-192.168.203.14@tcp:101:lctl.0 Request processed in 392us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201203.896233:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 141 00000100:00100000:2.0:1788201203.982440:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201203.982525:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614091904 00000100:00100000:3.0:1788201203.982535:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614091904 00000100:00100000:3.0:1788201203.982593:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 142 00000100:00100000:3.0:1788201203.982603:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+15:11342:x1875064614091904:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:3.0:1788201203.982622:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201203.982644:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b787487 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f37 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.982724:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b78748e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.982739:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b78748e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.982768:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b78748e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.982782:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b787495 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.982790:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b787495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.982797:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b787495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.982910:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b78749c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.982918:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b78749c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.982925:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b78749c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201203.982955:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1788201203.982971:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201203.982995:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b78749c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.983007:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b78748e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.983014:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b78748e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.983032:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b78748e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.983038:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201203.983042:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b78748e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.983049:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b78748e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.983070:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00109a1f00) 00010000:00010000:3.0:1788201203.983073:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201203.983077:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b78748e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.983084:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b78748e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.983100:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b787495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.983106:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b787495 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.983112:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b787495 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.983116:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201203.983118:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b787495 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.983181:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b787495 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.983192:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b00109a1300) 00010000:00010000:3.0:1788201203.983195:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201203.983198:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b787495 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.983204:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6000/0x72011f792b787495 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.983235:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7400/0x72011f792b787487 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f37 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.983249:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b78749c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f37 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.983258:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:3.0:1788201203.983260:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788201203.983263:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00029c7a00, rc 0) 00000100:00100000:3.0:1788201203.983329:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+16:11342:x1875064614091904:12345-192.168.203.14@tcp:101:bash.0 Request processed in 727us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201203.983336:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 142 00000100:00100000:0.0:1788201203.987664:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201203.987732:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614092160 00000100:00100000:3.0:1788201203.987742:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614092160 00000100:00100000:3.0:1788201203.987831:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 143 00000100:00100000:3.0:1788201203.987841:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+16:11342:x1875064614092160:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:3.0:1788201203.987872:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201203.987890:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b7874a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f3e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.988192:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b7874aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.988206:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b7874aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.988218:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b7874aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.988275:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b7874b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.988283:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b7874b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.988289:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b7874b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201203.988945:0:5827:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788201203.989285:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7874b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.989297:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7874b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.989306:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7874b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.989354:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b7874aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.989362:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b7874aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.989368:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b7874aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.989374:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201203.989378:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b7874aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.989386:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b7874aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.989398:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:3.0:1788201203.989401:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201203.989405:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b7874aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.989411:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6a00/0x72011f792b7874aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201203.989426:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000524b5e5a reply state 00000000109cdb26 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b7874b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201203.989434:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201203.989466:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c6600/0x72011f792b7874a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f3e expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.989623:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7874b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f3e expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.989631:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1700) 00010000:00010000:3.0:1788201203.989634:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201203.989637:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000030a00, rc 0) 00000100:00100000:3.0:1788201203.989719:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:11342:x1875064614092160:12345-192.168.203.14@tcp:101:bash.0 Request processed in 1878us (2065us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788201203.989727:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 143 00010000:00010000:3.0:1788201203.991649:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b7874b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.991664:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b7874b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.991671:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b7874b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.991677:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201203.991681:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b7874b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.991689:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b7874b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.991713:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b00109a1200) 00010000:00010000:3.0:1788201203.993766:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201203.993777:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b7874b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201203.993806:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b7874b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201203.995389:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201203.995894:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614092288 00000100:00100000:1.0:1788201203.995904:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614092288 00000100:00080000:3.0:1788201203.996039:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201203.996092:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 47 00000100:00100000:1.0:1788201203.996104:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2348:x1875064614092288:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788201203.996123:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201203.996184:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b7874c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f45 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201203.996214:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201203.996232:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=283s v=(0 0) 00010000:00010000:1.0:1788201203.996237:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201203.996246:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b7874c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f45 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201203.996267:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b7874c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f45 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201203.996280:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b00126fcc00, rc 0) 00000100:00100000:1.0:1788201203.996335:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2348:x1875064614092288:12345-192.168.203.14@tcp:101:bash.0 Request processed in 234us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201203.996343:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 47 00000100:00100000:0.0:1788201203.999982:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201204.000119:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614092416 00000100:00100000:3.0:1788201204.000128:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614092416 00000100:00100000:3.0:1788201204.000222:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:3.0:1788201204.000232:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:11342:x1875064614092416:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:3.0:1788201204.000249:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201204.000266:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000795cb628/0x72011f792b7874cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f4c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.000297:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b7874c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f45 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.000305:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201204.000309:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201204.000314:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000795cb628/0x72011f792b7874cd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f4c expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.000342:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b7874c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f45 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.000355:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b7874c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f45 expref: 7 pid: 6677 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201204.000386:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6678:1875064622485120:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201204.000474:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00081bc000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201204.003670:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6678:1875064622485120:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788201204.003726:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000795cb628/0x72011f792b7874cd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f4c expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201204.003748:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000030200, rc 0) 00000100:00100000:0.0:1788201204.003809:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:11342:x1875064614092416:12345-192.168.203.14@tcp:101:bash.0 Request processed in 3578us (3834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201204.003832:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:0.0:1788201204.008312:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201204.008393:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614092544 00000100:00100000:1.0:1788201204.008402:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614092544 00010000:00010000:1.0:1788201204.008440:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b7874c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f45 expref: 7 pid: 6677 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201204.008490:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 62 00000100:00100000:1.0:1788201204.008501:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2349:x1875064614092544:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201204.008516:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201204.008539:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b7874c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f45 expref: 7 pid: 6677 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.008553:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b7874c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f45 expref: 7 pid: 6677 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.008576:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b7874c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f45 expref: 7 pid: 6677 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.008594:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201204.008599:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201204.008607:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000795cb628/0x72011f792b7874cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f4c expref: 6 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.008617:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000795cb628/0x72011f792b7874cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f4c expref: 6 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.008658:0:5812:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000795cb628/0x72011f792b7874cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f4c expref: 6 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201204.008687:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004044d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5812:1875064622485248:192.168.203.14@tcp:105: 00000100:00100000:1.0:1788201204.008784:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005f6b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201204.012853:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201204.013174:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614092800 00000100:00100000:3.0:1788201204.013183:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614092800 00000100:00100000:3.0:1788201204.013238:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 36 00000100:00100000:3.0:1788201204.013247:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+18:11342:x1875064614092800:12345-192.168.203.14@tcp:35:bash.0 00000100:00100000:3.0:1788201204.013585:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:11342:x1875064614092800:12345-192.168.203.14@tcp:35:bash.0 Request processed in 332us (734us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788201204.013594:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 36 00000100:00100000:0.0:1788201204.013923:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004044d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5812:1875064622485248:192.168.203.14@tcp:105: 00010000:00010000:0.0:1788201204.013944:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201204.013980:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614092544:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 5481us (5677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201204.013989:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 62 00000100:00100000:3.0:1788201204.141194:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201204.141345:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614093056 00000100:00100000:2.0:1788201204.141355:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614093056 00000100:00100000:2.0:1788201204.141414:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 144 00000100:00100000:2.0:1788201204.141424:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:11353:x1875064614093056:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788201204.141447:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201204.141468:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7874d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f53 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201204.141598:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788201204.141730:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7874d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f53 expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.141746:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00109a1f00) 00010000:00010000:2.0:1788201204.141749:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201204.141754:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7874d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f53 expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.141767:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1a00, rc 0) 00000100:00100000:2.0:1788201204.141831:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:11353:x1875064614093056:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 408us (647us total) trans 4294967420 rc 301/301 00000100:00100000:2.0:1788201204.141838:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 144 00000100:00100000:0.0:1788201204.146888:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201204.146977:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614093312 00000100:00100000:3.0:1788201204.146987:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614093312 00000100:00100000:3.0:1788201204.147043:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 37 00000100:00100000:3.0:1788201204.147053:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:11353:x1875064614093312:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:3.0:1788201204.147346:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:11353:x1875064614093312:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 293us (466us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788201204.147353:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 37 00010000:00010000:2.0:1788201204.171315:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201204.270116:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201204.270590:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614093440 00000100:00100000:2.0:1788201204.270600:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614093440 00000100:00100000:2.0:1788201204.270660:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 145 00000100:00100000:2.0:1788201204.270669:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:11359:x1875064614093440:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788201204.270711:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201204.270744:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7874e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f5a expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.270809:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7874e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.270822:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7874e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.270834:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7874e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201204.270891:0:9471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1788201204.270895:0:9471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201204.270918:0:9471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7874e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.270944:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7874e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f5a expref: 23 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.270962:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7874e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f5a expref: 22 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.270971:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:2.0:1788201204.270984:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201204.270989:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0000, rc 0) 00000100:00100000:2.0:1788201204.271051:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:11359:x1875064614093440:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 383us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201204.271058:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 145 00000100:00100000:0.0:1788201204.274409:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201204.274500:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614093696 00000100:00100000:2.0:1788201204.274510:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614093696 00000100:00100000:2.0:1788201204.274565:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 146 00000100:00100000:2.0:1788201204.274574:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:11359:x1875064614093696:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788201204.274593:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201204.274612:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7874f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f61 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.274715:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7874f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.274729:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7874f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.274740:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7874f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201204.274752:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788201204.274888:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7874f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f61 expref: 25 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.274908:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7874f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f61 expref: 24 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.274933:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1700) 00010000:00010000:2.0:1788201204.274936:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201204.274940:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0e00, rc 0) 00000100:00100000:2.0:1788201204.275007:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+24:11359:x1875064614093696:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 433us (604us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788201204.275014:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 146 00000100:00100000:0.0:1788201204.281265:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201204.281307:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201204.281381:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614093952 00000100:00100000:3.0:1788201204.281390:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614093952 00000100:00100000:3.0:1788201204.281447:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 147 00000100:00100000:3.0:1788201204.281456:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+24:11359:x1875064614093952:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788201204.281480:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201204.281500:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787505 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f68 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.281607:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b78750c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.281622:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b78750c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.281633:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b78750c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201204.281643:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:1.0:1788201204.281754:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614094080 00000100:00100000:1.0:1788201204.281759:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614094080 00010000:00010000:3.0:1788201204.281774:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787505 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f68 expref: 28 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.281799:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b78750c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f68 expref: 27 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201204.281805:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00010000:00010000:3.0:1788201204.281808:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1700) 00010000:00010000:3.0:1788201204.281811:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:1.0:1788201204.281812:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f39aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:2350:x1875064614094080:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201204.281814:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000030800, rc 0) 00010000:00010000:1.0:1788201204.281821:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201204.281834:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7874f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f61 expref: 27 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.281844:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1700) 00010000:00010000:1.0:1788201204.281846:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201204.281867:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:11359:x1875064614093952:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 412us (615us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788201204.281879:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 147 00000100:00100000:1.0:1788201204.285456:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f39aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+25:2350:x1875064614094080:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 3631us (4134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201204.285471:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:0.0:1788201204.295300:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201204.295354:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614094208 00000100:00100000:1.0:1788201204.295363:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614094208 00000100:00100000:1.0:1788201204.295425:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:1.0:1788201204.295435:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614094208:12345-192.168.203.14@tcp:1:lfs.0 00010000:00010000:1.0:1788201204.295485:0:7765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b78751a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.295505:0:7765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000795cb628/0x72011f792b7874cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f4c expref: 6 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.295533:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201204.295537:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201204.295542:0:7765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b78751a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.295582:0:7765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000795cb628/0x72011f792b7874cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f4c expref: 6 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.295596:0:7765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000795cb628/0x72011f792b7874cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f4c expref: 6 pid: 6678 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201204.295612:0:7765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004044ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7765:1875064622485376:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201204.295710:0:7765:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005f6b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201204.297606:0:7765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004044ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7765:1875064622485376:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201204.297633:0:7765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b78751a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201204.298796:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201204.298891:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614094336 00000100:00100000:1.0:1788201204.298899:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614094336 00002000:00100000:1.0:1788201204.298950:0:6682:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b003f37b800 x1875064614094336/t0(0) o4->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:325/0 lens 504/0 e 0 to 0 dl 1788201215 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201204.298969:0:6682:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b003f37b800 with x1875064614094336 ext(0->12) 00010000:00010000:1.0:1788201204.298977:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000795cb628/0x72011f792b7874cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f4c expref: 7 pid: 6678 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.299012:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000795cb628/0x72011f792b7874cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f4c expref: 7 pid: 6678 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201204.299020:0:6682:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b003f37b800 00000100:00100000:1.0:1788201204.299056:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:1.0:1788201204.299067:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2348:x1875064614094336:12345-192.168.203.14@tcp:4:lfs.0 00000100:00100000:1.0:1788201204.299597:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:2348:x1875064614094336:12345-192.168.203.14@tcp:4:lfs.0 Request processed in 530us (805us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788201204.299606:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 2 00002000:00100000:1.0:1788201204.299614:0:6682:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b003f37b800 x1875064614094336/t4294967305(0) o4->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:325/0 lens 504/448 e 0 to 0 dl 1788201215 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201204.299622:0:6682:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b003f37b800 with x1875064614094336 ext(0->12) 00010000:00010000:1.0:1788201204.299628:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000795cb628/0x72011f792b7874cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f4c expref: 9 pid: 6678 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.299639:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000795cb628/0x72011f792b7874cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f4c expref: 9 pid: 6678 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201204.299646:0:6682:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b003f37b800 00000100:00100000:3.0:1788201204.302474:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201204.302588:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614094464 00000100:00100000:2.0:1788201204.302598:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614094464 00010000:00010000:2.0:1788201204.302637:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000795cb628/0x72011f792b7874cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f4c expref: 9 pid: 6678 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201204.302678:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 63 00000100:00100000:2.0:1788201204.302688:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:2349:x1875064614094464:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201204.302712:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788201204.302731:0:5813:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788201204.302735:0:5813:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788201203 00002000:00010000:2.0:1788201204.302737:0:5813:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788201204 00002000:00010000:2.0:1788201204.302739:0:5813:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788201203 00010000:00010000:2.0:1788201204.302745:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000795cb628/0x72011f792b7874cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f4c expref: 9 pid: 6678 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.302757:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000795cb628/0x72011f792b7874cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f4c expref: 9 pid: 6678 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.302780:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000795cb628/0x72011f792b7874cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f4c expref: 9 pid: 6678 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.302812:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201204.302817:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201204.302823:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b78751a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.302833:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b78751a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.302875:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201204.302941:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2349:x1875064614094464:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 254us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201204.302949:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 63 00010000:00010000:1.0:1788201204.303629:0:7765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b78751a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.303642:0:7765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b78751a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.303684:0:7765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b78751a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.303701:0:7765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b78751a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.303710:0:7765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b78751a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.303717:0:7765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fcc00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201204.303722:0:7765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b78751a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.303731:0:7765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b78751a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.303743:0:7765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b78751a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.303749:0:7765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000530fb119/0x72011f792b78751a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201204.303812:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2349:x1875064614094208:12345-192.168.203.14@tcp:1:lfs.0 Request processed in 8378us (8521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201204.303820:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:3.0:1788201204.307465:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201204.307549:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614094720 00000100:00100000:1.0:1788201204.307562:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614094720 00000100:00100000:1.0:1788201204.307621:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 38 00000100:00100000:1.0:1788201204.307631:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002289f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+25:11359:x1875064614094720:12345-192.168.203.14@tcp:35:lfs.0 00000004:00010000:1.0:1788201204.307708:0:5831:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b78750c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f68 expref: 25 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201204.307979:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788201204.308028:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788201204.308605:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:1.0:1788201204.308663:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787521 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.308679:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7874b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f3e expref: 29 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.308689:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787521 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.308734:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7874b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f3e expref: 29 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201204.308751:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7874b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f3e expref: 29 pid: 5827 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201204.308765:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004044ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5831:1875064622485504:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201204.308852:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005f6b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201204.314223:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004044ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5831:1875064622485504:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201204.314267:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787521 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201204.314685:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201204.314777:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614094848 00000100:00100000:0.0:1788201204.314784:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614094848 00010000:00010000:0.0:1788201204.314821:0:6691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7874b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f3e expref: 30 pid: 5827 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201204.314861:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 64 00000100:00100000:0.0:1788201204.314872:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006799c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+30:2348:x1875064614094848:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201204.314886:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201204.314893:0:6691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7874b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f3e expref: 30 pid: 5827 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201204.314905:0:6691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7874b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f3e expref: 30 pid: 5827 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201204.314936:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7874b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f3e expref: 30 pid: 5827 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201204.314966:0:6691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1700) 00010000:00010000:0.0:1788201204.314971:0:6691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787521 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201204.314981:0:6691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787521 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201204.314988:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787521 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201204.315023:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201204.315083:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006799c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+29:2348:x1875064614094848:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 212us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201204.315091:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 64 00010000:00010000:3.0:1788201204.315234:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787521 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.315252:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787521 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201204.315367:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:3.0:1788201204.315576:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788201204.315678:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f37e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5831:1875064622485632:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788201204.315735:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201204.315770:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00081bc840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201204.315884:0:12067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622485632 00000100:00100000:0.0:1788201204.315890:0:12067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622485632 00000100:00100000:0.0:1788201204.315940:0:12067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201204.315949:0:12067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5831:x1875064622485632:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788201204.316024:0:12067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5831:x1875064622485632:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 76us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201204.316032:0:12067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201204.316070:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f37e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5831:1875064622485632:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788201204.316553:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1788201204.316608:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f378e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5831:1875064622485760:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788201204.316656:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201204.316675:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00063153c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201204.316887:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622485760 00000100:00100000:2.0:1788201204.316893:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622485760 00000100:00100000:2.0:1788201204.316930:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201204.316938:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1875064622485760:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788201204.317091:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1875064622485760:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 153us (434us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788201204.317099:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788201204.318243:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201204.318469:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f378e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5831:1875064622485760:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788201204.318562:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788201204.318616:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787521 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201204.318627:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787521 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201204.318634:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787521 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201204.318641:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fd400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201204.318645:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787521 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201204.318652:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787521 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201204.318667:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1700) 00010000:00010000:0.0:1788201204.318670:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788201204.318675:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787521 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201204.318681:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b787521 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201204.318890:0:5831:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788201204.319013:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1788201204.319024:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 283443889917ns, next at 284443887642ns, rc = 0 00000001:00080000:0.0:1788201204.319043:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1788201204.319079:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1700) 00010000:00010000:0.0:1788201204.319082:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788201204.319088:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b78750c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f68 expref: 33 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201204.319242:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002289f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:11359:x1875064614094720:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 11611us (11787us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1788201204.319252:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 38 00000020:00080000:0.0:1788201204.319257:0:5831:0:(tgt_main.c:807:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788201204.323754:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201204.323841:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614094976 00000100:00100000:2.0:1788201204.323861:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614094976 00000100:00100000:2.0:1788201204.323927:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 148 00000100:00100000:2.0:1788201204.323938:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:11359:x1875064614094976:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788201204.324329:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201204.324353:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b787528 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f6f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.324420:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b787528 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f6f expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.324434:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b787528 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f6f expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.324453:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:2.0:1788201204.324456:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201204.324460:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1600, rc 0) 00000100:00100000:2.0:1788201204.325028:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+33:11359:x1875064614094976:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1089us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201204.325037:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 148 00000100:00100000:3.0:1788201204.339689:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201204.339810:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614095232 00000100:00100000:2.0:1788201204.339821:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614095232 00000100:00100000:2.0:1788201204.339885:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:2.0:1788201204.339895:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+33:11359:x1875064614095232:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:2.0:1788201204.340166:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+34:11359:x1875064614095232:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 272us (485us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1788201204.340174:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:2.0:1788201204.483028:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201204.483203:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614095488 00000100:00100000:3.0:1788201204.483213:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614095488 00000100:00100000:3.0:1788201204.483277:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 149 00000100:00100000:3.0:1788201204.483287:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+34:11369:x1875064614095488:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788201204.483316:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201204.483338:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b78752f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f76 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201204.483456:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788201204.483573:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b78752f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f76 expref: 36 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.483588:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00109a1f00) 00010000:00010000:3.0:1788201204.483592:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201204.483596:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b78752f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f76 expref: 36 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.483632:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000031800, rc 0) 00000100:00100000:3.0:1788201204.483704:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:11369:x1875064614095488:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 418us (686us total) trans 4294967434 rc 301/301 00000100:00100000:3.0:1788201204.483712:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 149 00000100:00100000:0.0:1788201204.489831:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201204.494423:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614095616 00000100:00100000:3.0:1788201204.494444:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614095616 00000100:00100000:3.0:1788201204.494534:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 150 00000100:00100000:3.0:1788201204.494546:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:11369:x1875064614095616:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:3.0:1788201204.494628:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b78753d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.494649:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b78753d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.494661:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b78753d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.494677:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787544 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.494684:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.494700:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.494809:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78754b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.494836:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78754b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.494843:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78754b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201204.494896:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78754b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.494907:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b78753d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.494913:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b78753d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.494929:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b78753d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.494935:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000031800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201204.494938:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b78753d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.494945:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b78753d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.494956:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:3.0:1788201204.494960:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201204.494963:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b78753d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.494969:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b78753d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.494994:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.495000:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787544 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.495006:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787544 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.495011:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000031000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201204.495014:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787544 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.495020:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787544 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.495028:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b00109a1200) 00010000:00010000:3.0:1788201204.495031:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201204.495034:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787544 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.495039:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787544 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.495390:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78754b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.495400:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78754b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.495407:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78754b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.495418:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201204.495422:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78754b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.495428:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78754b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.495438:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:3.0:1788201204.495440:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201204.495443:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78754b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.495449:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78754b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201204.495683:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:11369:x1875064614095616:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 1136us (5860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201204.495701:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 150 00000100:00100000:1.0:1788201204.503573:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201204.505557:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614095872 00000100:00100000:2.0:1788201204.505569:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614095872 00000100:00100000:2.0:1788201204.505676:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:2.0:1788201204.505687:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:11369:x1875064614095872:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:2.0:1788201204.506307:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+36:11369:x1875064614095872:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 617us (2740us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788201204.506329:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:0.0:1788201204.507522:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201204.507548:0:12066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614096128 00000100:00100000:0.0:1788201204.507554:0:12066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614096128 00000100:00100000:0.0:1788201204.507598:0:12066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 68 00000100:00100000:0.0:1788201204.507606:0:12066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2350:x1875064614096128:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201204.507653:0:12066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2350:x1875064614096128:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 48us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201204.507660:0:12066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 68 00000100:00080000:0.0:1788201204.507680:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201204.507717:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201204.507798:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201204.507824:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201204.507842:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614096256 00000100:00100000:3.0:1788201204.508025:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614096384 00000100:00100000:3.0:1788201204.508029:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614096384 00000100:00100000:3.0:1788201204.508065:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 138 00000100:00100000:3.0:1788201204.508071:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2350:x1875064614096384:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201204.508104:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2350:x1875064614096384:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 33us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201204.508110:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 138 00000100:00100000:3.0:1788201204.508176:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614096000 00000100:00100000:3.0:1788201204.508179:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614096000 00000100:00100000:3.0:1788201204.508202:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 288 00000100:00100000:3.0:1788201204.508219:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2350:x1875064614096000:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201204.508245:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2350:x1875064614096000:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 27us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201204.508251:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 288 00000100:00100000:0.0:1788201204.508382:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614096256 00000100:00100000:0.0:1788201204.508415:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:0.0:1788201204.508421:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2350:x1875064614096256:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201204.508458:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2350:x1875064614096256:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 38us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201204.508465:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:3.0:1788201204.576775:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201204.576885:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614096640 00000100:00100000:2.0:1788201204.576895:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614096640 00000100:00100000:2.0:1788201204.576962:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 151 00000100:00100000:2.0:1788201204.576973:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+36:11372:x1875064614096640:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788201204.577000:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201204.577021:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787552 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f7d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577106:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787559 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577122:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787559 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577174:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787559 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577191:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787560 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577198:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577206:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577329:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787567 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577355:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787567 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577364:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787567 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201204.577374:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788201204.577469:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787559 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577476:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787559 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577482:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787559 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577488:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201204.577492:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787559 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577499:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787559 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577510:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:2.0:1788201204.577513:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201204.577517:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787559 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577523:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b787559 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577536:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577551:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787560 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577557:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577562:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201204.577565:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577571:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787560 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577580:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b0011cb3b00) 00010000:00010000:2.0:1788201204.577582:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201204.577585:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787560 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577590:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b787560 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577624:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787552 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f7d expref: 39 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577636:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787567 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f7d expref: 38 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.577642:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:2.0:1788201204.577644:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201204.577651:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0200, rc 0) 00000100:00100000:2.0:1788201204.577712:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+38:11372:x1875064614096640:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 741us (947us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788201204.577719:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 151 00000100:00100000:0.0:1788201204.581895:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201204.582039:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614096768 00000100:00100000:3.0:1788201204.582049:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614096768 00000100:00100000:3.0:1788201204.582108:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 152 00000100:00100000:3.0:1788201204.582119:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+38:11372:x1875064614096768:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:3.0:1788201204.582217:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787575 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.582232:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.582243:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.582275:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.582282:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787575 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.582289:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787575 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.582295:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000031000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201204.582299:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787575 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.582318:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787575 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.582330:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:3.0:1788201204.582332:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201204.582337:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787575 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.582343:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787575 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201204.582413:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+38:11372:x1875064614096768:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 296us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201204.582421:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 152 00000100:00100000:0.0:1788201204.587782:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201204.587961:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614097024 00000100:00100000:1.0:1788201204.587971:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614097024 00000100:00100000:1.0:1788201204.588027:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 41 00000100:00100000:1.0:1788201204.588036:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+38:11372:x1875064614097024:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788201204.588289:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+39:11372:x1875064614097024:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 252us (528us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788201204.588297:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 41 00000100:00100000:2.0:1788201204.940308:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201204.940401:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614097280 00000100:00100000:3.0:1788201204.940412:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614097280 00000100:00100000:3.0:1788201204.940475:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 153 00000100:00100000:3.0:1788201204.940484:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+39:11403:x1875064614097280:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:3.0:1788201204.940509:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201204.940530:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b78757c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f84 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.940626:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b787583 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.940639:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b787583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.940653:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b787583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201204.940678:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788201204.940827:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b78757c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f84 expref: 42 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.940852:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b787583 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f84 expref: 41 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201204.940861:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:3.0:1788201204.940864:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201204.940868:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000030e00, rc 0) 00000100:00100000:3.0:1788201204.940933:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+41:11403:x1875064614097280:12345-192.168.203.14@tcp:101:cat.0 Request processed in 449us (633us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788201204.940940:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 153 00000100:00100000:0.0:1788201204.944710:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201204.944866:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614097408 00000100:00100000:2.0:1788201204.944875:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614097408 00000100:00100000:2.0:1788201204.944941:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:2.0:1788201204.944952:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+41:2348:x1875064614097408:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201204.944968:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201204.944993:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b787583 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f84 expref: 41 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201204.945016:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:2.0:1788201204.945020:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201204.945075:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+40:2348:x1875064614097408:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 125us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201204.945083:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:0.0:1788201204.955981:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201204.956064:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614097664 00000100:00100000:2.0:1788201204.956074:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614097664 00000100:00100000:2.0:1788201204.956154:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:2.0:1788201204.956165:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+40:11403:x1875064614097664:12345-192.168.203.14@tcp:35:cat.0 00000100:00100000:2.0:1788201204.956457:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+41:11403:x1875064614097664:12345-192.168.203.14@tcp:35:cat.0 Request processed in 294us (484us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788201204.956465:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:0.0:1788201205.063107:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201205.064383:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614097920 00000100:00100000:3.0:1788201205.064394:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614097920 00000100:00100000:3.0:1788201205.064478:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 154 00000100:00100000:3.0:1788201205.064490:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+41:11409:x1875064614097920:12345-192.168.203.14@tcp:101:dd.0 00010000:00010000:3.0:1788201205.064514:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201205.064517:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788201205.064544:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7874e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f5a expref: 41 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.064562:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:3.0:1788201205.064566:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201205.064578:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787591 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f8b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.064705:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787598 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.064719:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787567 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f7d expref: 41 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.064727:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787598 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.064758:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787567 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f7d expref: 41 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.064772:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787567 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f7d expref: 41 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201205.064784:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035c04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5827:1875064622485888:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201205.064873:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f39f180 going to sleep for 11 seconds 00000100:00080000:0.0:1788201205.065204:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201205.074518:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035c04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5827:1875064622485888:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788201205.074548:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787598 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201205.079901:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201205.080295:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614098048 00000100:00100000:1.0:1788201205.080306:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614098048 00010000:00010000:1.0:1788201205.080347:0:6691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787567 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f7d expref: 42 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.080395:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 65 00000100:00100000:1.0:1788201205.080407:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+42:2349:x1875064614098048:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201205.080423:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201205.080432:0:6691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787567 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f7d expref: 42 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.080446:0:6691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787567 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f7d expref: 42 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.080471:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0200/0x72011f792b787567 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f7d expref: 42 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.080509:0:6691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:1.0:1788201205.080515:0:6691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787598 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.080526:0:6691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787598 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.080533:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787598 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.080562:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201205.080611:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+41:2349:x1875064614098048:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 208us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.080619:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 65 00010000:00010000:3.0:1788201205.080836:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787598 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.080853:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787598 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201205.080883:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788201205.081339:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787591 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f8b expref: 42 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.081371:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787598 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f8b expref: 41 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.081382:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:3.0:1788201205.081386:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788201205.081389:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000031000, rc 0) 00000100:00100000:3.0:1788201205.081469:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+41:11409:x1875064614097920:12345-192.168.203.14@tcp:101:dd.0 Request processed in 16982us (18370us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1788201205.081478:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 154 00000100:00100000:0.0:1788201205.099165:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201205.099337:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614098304 00000100:00100000:3.0:1788201205.099351:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614098304 00000100:00100000:3.0:1788201205.099429:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 155 00000100:00100000:3.0:1788201205.099441:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+41:11409:x1875064614098304:12345-192.168.203.14@tcp:36:dd.0 00010000:00010000:3.0:1788201205.099839:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b7875a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.099863:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b7875a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.099878:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b7875a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201205.099939:0:5828:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:3.0:1788201205.099965:0:5828:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a83a9d8 reply state 000000009f4a3592 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b7875a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201205.099975:0:5828:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201205.100101:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+44:11409:x1875064614098304:12345-192.168.203.14@tcp:36:dd.0 Request processed in 660us (970us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788201205.100109:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 155 00000020:00080000:3.0:1788201205.100115:0:5828:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788201205.102620:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b7875a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201205.102652:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b7875a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201205.102660:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b7875a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201205.102670:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201205.102954:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b7875a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201205.102966:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b7875a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201205.102984:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:2.0:1788201205.102987:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201205.102992:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b7875a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201205.102999:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b7875a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788201205.117956:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967432 is committed 00000004:00080000:0.0:1788201205.117978:0:5849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788201205.118002:0:5849:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b0006315cc0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788201205.118007:0:5849:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b0040454d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b0006315b40 00000020:00080000:0.0:1788201205.118011:0:5849:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b0040454800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b0005d6e400 00000020:00080000:2.0:1788201205.118093:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000001:00080000:0.0:1788201205.118286:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967437 is committed 00000001:00080000:0.0:1788201205.118314:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000020:00080000:2.0:1788201205.118469:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788201205.118662:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004044c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622486016:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201205.121378:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201205.128080:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622486016 00000100:00100000:1.0:1788201205.128093:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622486016 00000100:00100000:1.0:1788201205.128186:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788201205.128198:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3294:x1875064622486016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201205.128231:0:7765:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1788201205.128268:0:7765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a95c8f3, atime: 0x6a95c8f4, ctime: 0x6a95c8f3, blocks: 0x1 00010000:00010000:1.0:1788201205.128521:0:7765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097f86c76/0x72011f792b7875ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.128540:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=284s v=(0 0) 00010000:00010000:1.0:1788201205.128545:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201205.128551:0:7765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097f86c76/0x72011f792b7875ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.128586:0:7765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097f86c76/0x72011f792b7875ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.128596:0:7765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097f86c76/0x72011f792b7875ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.128603:0:7765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097f86c76/0x72011f792b7875ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.128634:0:7765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201205.129413:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201205.129422:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097f86c76/0x72011f792b7875ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.129432:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fdc00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201205.129437:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097f86c76/0x72011f792b7875ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.129446:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097f86c76/0x72011f792b7875ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.129462:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097f86c76/0x72011f792b7875ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.129469:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097f86c76/0x72011f792b7875ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.129490:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201205.129492:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201205.129494:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201205.130017:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3294:x1875064622486016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1817us (8641us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788201205.130027:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1788201205.130115:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b004044c000/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788201205.130122:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004044c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622486016:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788201205.195592:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201205.427255:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201205.427420:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614098432 00000100:00100000:1.0:1788201205.427433:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614098432 00000100:00100000:1.0:1788201205.427507:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 156 00000100:00100000:1.0:1788201205.427519:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f39aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:11423:x1875064614098432:12345-192.168.203.14@tcp:101:stat.0 00010000:00010000:1.0:1788201205.427550:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201205.427582:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b7875b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f92 expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.427667:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7875bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.427693:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7875bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.427707:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7875bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.427747:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b7875c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.427755:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b7875c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.427763:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b7875c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.428757:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b7875c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.428779:0:9471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787598 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f8b expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.428789:0:9471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b7875c9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.428838:0:9471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787598 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f8b expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.428855:0:9471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787598 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f8b expref: 20 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.428873:0:9471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004044f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9471:1875064622486144:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201205.429056:0:9471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005f6b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201205.431156:0:9471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004044f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9471:1875064622486144:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201205.431194:0:9471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b7875c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201205.431768:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201205.431825:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614098688 00000100:00100000:1.0:1788201205.431833:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614098688 00000100:00100000:1.0:1788201205.431893:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:1.0:1788201205.431901:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:5585:x1875064614098688:12345-192.168.203.14@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788201205.432382:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:5585:x1875064614098688:12345-192.168.203.14@tcp:35:ldlm_bl.0 Request processed in 478us (613us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1788201205.432392:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:0.0:1788201205.435654:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201205.435815:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614098816 00000100:00100000:2.0:1788201205.435831:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614098816 00010000:00010000:2.0:1788201205.435904:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787598 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f8b expref: 22 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201205.435956:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 66 00000100:00100000:2.0:1788201205.435966:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:2349:x1875064614098816:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201205.435994:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201205.436004:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787598 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f8b expref: 22 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201205.436021:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787598 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f8b expref: 22 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201205.436054:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787598 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f8b expref: 22 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201205.436082:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:2.0:1788201205.436088:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b7875c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201205.436101:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b7875c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201205.436219:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b7875c9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201205.436259:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201205.436308:0:9471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b7875c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436321:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b7875c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201205.436331:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:2349:x1875064614098816:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 366us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201205.436347:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 66 00000004:00200000:0.0:1788201205.436403:0:9471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788201205.436409:0:9471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201205.436438:0:9471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b7875c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436455:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b7875c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436483:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7875bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436491:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7875bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436499:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7875bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436510:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fcc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201205.436515:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7875bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436524:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7875bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436536:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:0.0:1788201205.436540:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201205.436544:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7875bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436551:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fcc00/0x72011f792b7875bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436579:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b7875c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436586:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b7875c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436593:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b7875c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436599:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fd400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201205.436602:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b7875c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436608:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b7875c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436616:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b00033b2600) 00010000:00010000:0.0:1788201205.436619:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201205.436622:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b7875c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436627:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fd400/0x72011f792b7875c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436673:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fdc00/0x72011f792b7875b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f92 expref: 21 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436700:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b7875c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f92 expref: 20 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.436728:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:0.0:1788201205.436730:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201205.436733:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681a00, rc 0) 00000100:00100000:0.0:1788201205.436780:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f39aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:11423:x1875064614098432:12345-192.168.203.14@tcp:101:stat.0 Request processed in 9263us (9539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201205.436789:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 156 00000100:00100000:0.0:1788201205.499425:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201205.499708:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614099072 00000100:00100000:3.0:1788201205.499741:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614099072 00000100:00100000:3.0:1788201205.499851:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 157 00000100:00100000:3.0:1788201205.499862:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:11429:x1875064614099072:12345-192.168.203.14@tcp:36:truncate.0 00010000:00010000:3.0:1788201205.499942:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201205.499978:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b7875c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f92 expref: 20 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.500004:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:3.0:1788201205.500010:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201205.500351:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7875d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.500368:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7875d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.500380:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7875d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201205.500437:0:5828:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:3.0:1788201205.500464:0:5828:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fd802e0 reply state 0000000017b1e1ef transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7875d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201205.500474:0:5828:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201205.500602:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:11429:x1875064614099072:12345-192.168.203.14@tcp:36:truncate.0 Request processed in 740us (1192us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1788201205.500611:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 157 00000020:00080000:3.0:1788201205.500616:0:5828:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788201205.503988:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7875d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.504010:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7875d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.504037:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7875d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.504044:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000031800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201205.504112:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7875d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.504122:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7875d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.504420:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:3.0:1788201205.504425:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201205.504431:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7875d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.504438:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7875d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.515577:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004044d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622486400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.515671:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201205.515763:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201205.515770:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622486528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.515794:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201205.515831:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622486400 00000100:00100000:1.0:1788201205.515840:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622486400 00000100:00100000:1.0:1788201205.515890:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622486528 00000100:00100000:1.0:1788201205.515893:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622486528 00000100:00100000:1.0:1788201205.515929:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788201205.515938:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622486400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.515999:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622486400:12345-0@lo:400:kworker.0 Request processed in 62us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.516007:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788201205.516025:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788201205.516031:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622486528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.516059:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622486528:12345-0@lo:400:kworker.0 Request processed in 29us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.516088:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1788201205.516108:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201205.516171:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622486528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.516184:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004044d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622486400:0@lo:400:kworker.0 00000100:00100000:0.0:1788201205.516291:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622486656:0@lo:400:kworker.0 00000100:00100000:0.0:1788201205.516330:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201205.516367:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201205.516374:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004044f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622486272:0@lo:400:kworker.0 00000100:00100000:0.0:1788201205.516402:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201205.516423:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1875064622486784:0@lo:400:kworker.0 00000100:00100000:0.0:1788201205.516465:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201205.516494:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622486784 00000100:00100000:0.0:1788201205.516498:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622486784 00000100:00100000:0.0:1788201205.516544:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788201205.516551:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875064622486784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201205.516589:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875064622486784:12345-0@lo:400:kworker.0 Request processed in 38us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201205.516595:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1788201205.516611:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201205.516631:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1875064622486784:0@lo:400:kworker.0 00000100:00100000:2.0:1788201205.516908:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201205.516919:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035fa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622486912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201205.516956:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201205.516990:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622486272 00000100:00100000:2.0:1788201205.516995:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622486272 00000100:00100000:2.0:1788201205.517032:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788201205.517039:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622486272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201205.517077:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622486272:12345-0@lo:400:kworker.0 Request processed in 39us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201205.517084:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788201205.517116:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622486912 00000100:00100000:2.0:1788201205.517120:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622486912 00000100:00100000:2.0:1788201205.517172:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788201205.517179:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1875064622486912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201205.517197:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201205.517236:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1875064622486912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201205.517242:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788201205.517282:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035fa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622486912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201205.517307:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004044f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622486272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201205.519718:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622486656 00000100:00100000:1.0:1788201205.519736:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622486656 00000100:00100000:1.0:1788201205.519859:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201205.519872:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622486656:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788201205.520322:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201205.520902:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622486656:12345-0@lo:400:kworker.0 Request processed in 1029us (4566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.520913:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788201205.521602:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622486656:0@lo:400:kworker.0 00000100:00100000:0.0:1788201205.625023:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201205.625104:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614099200 00000100:00100000:1.0:1788201205.625117:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614099200 00000100:00100000:1.0:1788201205.625222:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 158 00000100:00100000:1.0:1788201205.625234:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:11443:x1875064614099200:12345-192.168.203.14@tcp:101:stat.0 00010000:00010000:1.0:1788201205.625266:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201205.625294:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7875d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2f99 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.626110:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7875de lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.626131:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7875de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.626399:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7875de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.626814:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7875e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.626827:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7875e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.626836:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7875e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.628527:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7875ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.628549:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7875ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.628561:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7875ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201205.628695:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788201205.628767:0:5828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201205.628796:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7875ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.628812:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7875ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.628822:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7875de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.628830:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7875de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.628853:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7875de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.628860:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201205.628865:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7875de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.628873:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7875de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.628888:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:1.0:1788201205.628892:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.628898:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7875de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.628903:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7875de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.628919:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7875e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.630761:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7875e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.630775:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7875e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.630782:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201205.630787:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7875e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.630822:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7875e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.630841:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b00033b2c00) 00010000:00010000:1.0:1788201205.630845:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.630850:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7875e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.630856:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7875e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.630945:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7875d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f99 expref: 23 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.630978:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7875ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f99 expref: 22 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.630993:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:1.0:1788201205.630996:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201205.630999:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680000, rc 0) 00000100:00100000:1.0:1788201205.631100:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:11443:x1875064614099200:12345-192.168.203.14@tcp:101:stat.0 Request processed in 5867us (6142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.631110:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 158 00000100:00100000:2.0:1788201205.714366:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201205.716770:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614099456 00000100:00100000:0.0:1788201205.716791:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614099456 00000100:00100000:0.0:1788201205.716897:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 159 00000100:00100000:0.0:1788201205.716910:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:11453:x1875064614099456:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788201205.716940:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201205.716970:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7875f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2fa0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201205.717368:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1788201205.717885:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7875f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fa0 expref: 24 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.717906:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00109a1f00) 00010000:00010000:0.0:1788201205.717910:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201205.717915:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b7875f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fa0 expref: 24 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.717933:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676f400, rc 0) 00000100:00100000:0.0:1788201205.718087:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+23:11453:x1875064614099456:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1179us (3737us total) trans 4294967446 rc 301/301 00000100:00100000:0.0:1788201205.718097:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 159 00000100:00100000:2.0:1788201205.720745:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201205.721120:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614099712 00000100:00100000:1.0:1788201205.721173:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614099712 00000100:00100000:1.0:1788201205.721246:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:1.0:1788201205.721258:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002289e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+23:11453:x1875064614099712:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788201205.721875:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002289e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+24:11453:x1875064614099712:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 616us (1142us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788201205.721885:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:3.0:1788201205.794115:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201205.794798:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614099968 00000100:00100000:0.0:1788201205.794812:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614099968 00000100:00100000:0.0:1788201205.794894:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 160 00000100:00100000:0.0:1788201205.794906:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+24:11459:x1875064614099968:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788201205.794972:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201205.795000:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b787601 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2fa7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.795164:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787608 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.795184:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7875ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f99 expref: 25 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.795194:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787608 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.795237:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7875ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f99 expref: 25 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.795264:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7875ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f99 expref: 25 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201205.795282:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f04380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5827:1875064622487040:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788201205.795413:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0006315600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201205.797558:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f04380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5827:1875064622487040:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788201205.797598:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787608 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201205.798210:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201205.798295:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614100096 00000100:00100000:1.0:1788201205.798305:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614100096 00010000:00010000:1.0:1788201205.798353:0:6691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7875ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f99 expref: 26 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.798413:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00100000:1.0:1788201205.798424:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:2348:x1875064614100096:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201205.798442:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201205.798449:0:6691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7875ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f99 expref: 26 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.798463:0:6691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7875ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f99 expref: 26 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.798491:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7875ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f99 expref: 26 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.798512:0:6691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:1.0:1788201205.798518:0:6691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787608 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.798530:0:6691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787608 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.798538:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787608 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.798596:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201205.798661:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+25:2348:x1875064614100096:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 238us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.798669:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 67 00010000:00010000:3.0:1788201205.799073:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787608 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.799083:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787608 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201205.799107:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788201205.799355:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f400/0x72011f792b787601 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fa7 expref: 26 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.799401:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787608 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fa7 expref: 25 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.799410:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:3.0:1788201205.799413:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788201205.799415:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676fa00, rc 0) 00000100:00100000:3.0:1788201205.799460:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+25:11459:x1875064614099968:12345-192.168.203.14@tcp:101:bash.0 Request processed in 4556us (5361us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1788201205.799469:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 160 00000100:00100000:2.0:1788201205.805344:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201205.805572:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614100352 00000100:00100000:1.0:1788201205.805586:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614100352 00000100:00100000:1.0:1788201205.805656:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 161 00000100:00100000:1.0:1788201205.805669:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+25:11459:x1875064614100352:12345-192.168.203.14@tcp:36:bash.0 00010000:00010000:1.0:1788201205.806078:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787616 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.806101:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787616 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.806115:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787616 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201205.807319:0:5829:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:1.0:1788201205.807447:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070774363 reply state 0000000002564c16 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787616 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.807462:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.807627:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:11459:x1875064614100352:12345-192.168.203.14@tcp:36:bash.0 Request processed in 1955us (2293us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788201205.807638:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 161 00000020:00080000:1.0:1788201205.807646:0:5829:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788201205.812347:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787616 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.812380:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787616 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.812389:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787616 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.812396:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201205.812401:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787616 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.812410:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787616 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.812432:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:3.0:1788201205.812435:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201205.812441:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787616 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.812470:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787616 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201205.822485:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201205.834367:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614100480 00000100:00100000:1.0:1788201205.834388:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614100480 00000100:00100000:1.0:1788201205.834505:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 162 00000100:00100000:1.0:1788201205.834539:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:11459:x1875064614100480:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788201205.834590:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201205.834619:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78761d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2fae expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.834762:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787624 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.834783:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787608 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fa7 expref: 28 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.834792:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787624 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.834843:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787608 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fa7 expref: 28 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.834858:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787608 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fa7 expref: 28 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.834876:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5828:1875064622487168:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201205.835010:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005f6b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201205.842565:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201205.842669:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614100608 00000100:00100000:0.0:1788201205.842689:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614100608 00010000:00010000:0.0:1788201205.842742:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787608 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fa7 expref: 29 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201205.842814:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 68 00000100:00100000:0.0:1788201205.842825:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f610380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+29:2349:x1875064614100608:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201205.842847:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201205.842855:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787608 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fa7 expref: 29 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.842869:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787608 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fa7 expref: 29 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.842896:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:0.0:1788201205.842903:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787624 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.842915:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.842924:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787624 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.842955:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201205.843029:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f610380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+29:2349:x1875064614100608:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 206us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201205.843037:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 68 00010000:00010000:1.0:1788201205.843227:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787608 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fa7 expref: 28 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.843250:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5828:1875064622487168:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201205.843279:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.843301:0:5828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.843308:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201205.843369:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788201205.843375:0:5828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201205.843399:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.843441:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78761d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fae expref: 28 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.843461:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fae expref: 27 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.843470:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:1.0:1788201205.843473:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201205.843476:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681800, rc 0) 00000100:00100000:1.0:1788201205.843519:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:11459:x1875064614100480:12345-192.168.203.14@tcp:101:bash.0 Request processed in 8984us (21050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.843526:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 162 00000100:00100000:2.0:1788201205.847500:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201205.847625:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614100864 00000100:00100000:0.0:1788201205.847639:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614100864 00000100:00100000:0.0:1788201205.847719:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:0.0:1788201205.847731:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:11459:x1875064614100864:12345-192.168.203.14@tcp:35:bash.0 00000100:00100000:0.0:1788201205.848062:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:11459:x1875064614100864:12345-192.168.203.14@tcp:35:bash.0 Request processed in 332us (575us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1788201205.848070:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:3.0:1788201205.916091:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201205.916318:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614101120 00000100:00100000:1.0:1788201205.916331:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614101120 00000100:00100000:1.0:1788201205.916464:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 163 00000100:00100000:1.0:1788201205.916487:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:11469:x1875064614101120:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788201205.916522:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201205.916566:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78762b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2fb5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201205.917060:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1788201205.917316:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78762b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fb5 expref: 30 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.917334:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00109a1f00) 00010000:00010000:1.0:1788201205.917337:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201205.917342:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78762b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fb5 expref: 30 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.917360:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680000, rc 0) 00000100:00100000:1.0:1788201205.917502:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+29:11469:x1875064614101120:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1017us (1427us total) trans 4294967452 rc 301/301 00000100:00100000:1.0:1788201205.917511:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 163 00000100:00100000:2.0:1788201205.920942:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201205.921115:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614101248 00000100:00100000:3.0:1788201205.921127:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614101248 00000100:00100000:3.0:1788201205.921355:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 164 00000100:00100000:3.0:1788201205.921368:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+29:11469:x1875064614101248:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:3.0:1788201205.921494:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787639 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.921515:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787639 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.921531:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787639 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.921549:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787640 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.921556:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787640 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.921562:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787640 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922018:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787647 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922029:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787647 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922053:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787647 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201205.922109:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787647 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922125:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787639 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922428:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787639 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922440:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787639 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922446:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201205.922452:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787639 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922460:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787639 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922525:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:3.0:1788201205.922529:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201205.922534:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787639 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922540:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787639 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922562:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787640 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922575:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787640 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922581:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787640 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922586:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000031800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201205.922589:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787640 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922595:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787640 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922603:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b00109a1200) 00010000:00010000:3.0:1788201205.922605:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201205.922608:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787640 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922614:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787640 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922631:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787647 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922637:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787647 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922642:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787647 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922647:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201205.922657:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787647 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922664:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787647 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922671:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:3.0:1788201205.922674:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201205.922676:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787647 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201205.922692:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787647 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201205.922837:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+29:11469:x1875064614101248:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 1468us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201205.922846:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 164 00000100:00100000:2.0:1788201205.925103:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201205.925343:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614101504 00000100:00100000:0.0:1788201205.925355:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614101504 00000100:00100000:0.0:1788201205.925443:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:0.0:1788201205.925455:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+29:11469:x1875064614101504:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:0.0:1788201205.926476:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+30:11469:x1875064614101504:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 1008us (1431us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788201205.926488:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:2.0:1788201205.971591:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201205.972400:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614101760 00000100:00100000:0.0:1788201205.972415:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614101760 00000100:00100000:0.0:1788201205.972612:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 165 00000100:00100000:0.0:1788201205.972627:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+30:11472:x1875064614101760:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788201205.972663:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201205.972702:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b78764e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2fbc expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.972810:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b787655 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.972827:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b787655 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.972842:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b787655 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.972860:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b78765c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.972886:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b78765c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.972893:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b78765c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.973361:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787663 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.973372:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.973380:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201205.973392:0:9471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788201205.973827:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b787655 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.973836:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b787655 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.973843:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b787655 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.973850:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676e000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201205.973856:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b787655 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.973865:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b787655 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.973894:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:0.0:1788201205.973897:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201205.973902:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b787655 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.973909:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e000/0x72011f792b787655 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.973925:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b78765c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.973931:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b78765c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.973937:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b78765c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.973942:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201205.973945:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b78765c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.973951:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b78765c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.973956:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b0002a80e00) 00010000:00010000:0.0:1788201205.973959:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201205.973961:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b78765c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.973966:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b78765c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.974029:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b78764e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fbc expref: 33 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.974053:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787663 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fbc expref: 32 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.974061:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:0.0:1788201205.974064:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201205.974066:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676f800, rc 0) 00000100:00100000:0.0:1788201205.974207:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:11472:x1875064614101760:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1583us (2632us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788201205.974216:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 165 00000100:00100000:2.0:1788201205.978103:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201205.978190:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201205.978292:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614102016 00000100:00100000:0.0:1788201205.978305:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614102016 00000100:00100000:0.0:1788201205.978389:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:0.0:1788201205.978401:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040425c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:2348:x1875064614102016:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201205.978422:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201205.978457:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787663 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fbc expref: 32 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201205.978481:0:6691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:0.0:1788201205.978486:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201205.978551:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040425c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:2348:x1875064614102016:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 152us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201205.978559:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:1.0:1788201205.978652:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614101888 00000100:00100000:1.0:1788201205.978657:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614101888 00000100:00100000:1.0:1788201205.978711:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 166 00000100:00100000:1.0:1788201205.978727:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:11472:x1875064614101888:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:1.0:1788201205.978807:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.978823:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.978834:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.978881:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.978888:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787671 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.978895:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.978903:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201205.978908:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.978916:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787671 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.978925:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:1.0:1788201205.978928:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201205.978932:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787671 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.978938:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787671 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.978976:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:11472:x1875064614101888:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 258us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201205.978983:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 166 00000100:00100000:2.0:1788201205.982474:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201205.982995:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614102272 00000100:00100000:1.0:1788201205.983010:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614102272 00000100:00100000:1.0:1788201205.983305:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 47 00000100:00100000:1.0:1788201205.983335:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:11472:x1875064614102272:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788201205.984391:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:11472:x1875064614102272:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 1052us (1933us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788201205.984403:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 47 00000100:00100000:3.0:1788201206.107963:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201206.108107:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614102528 00000100:00100000:1.0:1788201206.108129:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614102528 00000100:00100000:1.0:1788201206.108244:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 167 00000100:00100000:1.0:1788201206.108254:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:11490:x1875064614102528:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:1.0:1788201206.108293:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201206.108320:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787678 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2fc3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.108448:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b78767f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.108466:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b78767f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.108477:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b78767f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201206.108491:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788201206.108658:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787678 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fc3 expref: 35 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.108693:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b78767f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fc3 expref: 34 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.108727:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:1.0:1788201206.108731:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788201206.108736:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680600, rc 0) 00000100:00100000:1.0:1788201206.108818:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+34:11490:x1875064614102528:12345-192.168.203.14@tcp:101:cat.0 Request processed in 565us (868us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788201206.108825:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 167 00000100:00100000:2.0:1788201206.136606:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201206.136941:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614102656 00000100:00100000:1.0:1788201206.136957:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614102656 00000100:00100000:1.0:1788201206.137040:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 168 00000100:00100000:1.0:1788201206.137232:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+34:11491:x1875064614102656:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788201206.137266:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201206.137292:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78768d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2fca expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.137374:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.137391:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.137404:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201206.137690:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1788201206.137696:0:5828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201206.137792:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.137839:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78768d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fca expref: 36 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.137862:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fca expref: 35 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.137873:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:1.0:1788201206.137876:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201206.137881:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681e00, rc 0) 00000100:00100000:1.0:1788201206.137968:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:11491:x1875064614102656:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 740us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201206.142220:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201206.142392:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614103040 00000100:00100000:3.0:1788201206.142406:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614103040 00000100:00100000:3.0:1788201206.142491:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:3.0:1788201206.142503:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+36:11491:x1875064614103040:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:3.0:1788201206.142947:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+37:11491:x1875064614103040:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 441us (738us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1788201206.142956:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:3.0:1788201206.145643:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201206.145744:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614103168 00000100:00100000:0.0:1788201206.145757:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614103168 00000100:00100000:0.0:1788201206.145839:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:0.0:1788201206.145851:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000679a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+37:11491:x1875064614103168:12345-192.168.203.14@tcp:103:lfs.0 00010000:00010000:0.0:1788201206.145871:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788201206.145905:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787624 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fae expref: 37 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.145931:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b78767f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fc3 expref: 36 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.145948:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b787528 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f6f expref: 35 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.145960:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0011cb3000) 00010000:00010000:0.0:1788201206.145971:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201206.146055:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000679a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+34:11491:x1875064614103168:12345-192.168.203.14@tcp:103:lfs.0 Request processed in 206us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201206.146065:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:1.0:1788201206.146380:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 168 00000100:00100000:3.0:1788201206.148404:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201206.148517:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614103296 00000100:00100000:0.0:1788201206.148532:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614103296 00000100:00100000:0.0:1788201206.148602:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 169 00000100:00100000:0.0:1788201206.148614:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+33:11491:x1875064614103296:12345-192.168.203.14@tcp:58:lfs.0 00010000:00010000:0.0:1788201206.148783:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b78769b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.148804:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b78769b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.148841:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b78769b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201206.149886:0:9471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788201206.153854:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+33:11491:x1875064614103296:12345-192.168.203.14@tcp:58:lfs.0 Request processed in 5218us (5434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201206.153879:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 169 00000100:00100000:3.0:1788201206.172631:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201206.173257:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614103424 00000100:00100000:0.0:1788201206.173267:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614103424 00000100:00100000:2.0:1788201206.174219:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 170 00000100:00100000:2.0:1788201206.174234:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+33:11493:x1875064614103424:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788201206.174256:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201206.174278:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217c600/0x72011f792b7876a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2fd1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174350:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217d000/0x72011f792b7876a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174364:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217d000/0x72011f792b7876a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174375:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217d000/0x72011f792b7876a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174393:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217da00/0x72011f792b7876b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174399:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217da00/0x72011f792b7876b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174405:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217da00/0x72011f792b7876b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174809:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7876b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174819:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7876b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174825:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7876b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201206.174860:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788201206.174864:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201206.174884:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7876b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174895:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7876b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174903:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217d000/0x72011f792b7876a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174909:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217d000/0x72011f792b7876a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174915:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217d000/0x72011f792b7876a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174921:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b004217d000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201206.174925:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217d000/0x72011f792b7876a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174933:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217d000/0x72011f792b7876a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174954:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:2.0:1788201206.174957:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201206.174962:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217d000/0x72011f792b7876a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174968:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217d000/0x72011f792b7876a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174982:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217da00/0x72011f792b7876b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174989:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217da00/0x72011f792b7876b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174994:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217da00/0x72011f792b7876b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.174999:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b004217da00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201206.175002:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217da00/0x72011f792b7876b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.175007:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217da00/0x72011f792b7876b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.175014:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b0011cb3100) 00010000:00010000:2.0:1788201206.175017:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201206.175019:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217da00/0x72011f792b7876b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.175025:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217da00/0x72011f792b7876b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.175068:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b004217c600/0x72011f792b7876a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fd1 expref: 35 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.175084:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7876b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fd1 expref: 34 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.175092:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0002a80e00) 00010000:00010000:2.0:1788201206.175094:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201206.175097:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1600, rc 0) 00000100:00100000:2.0:1788201206.175217:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+34:11493:x1875064614103424:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 987us (2595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201206.175225:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 170 00010000:00010000:0.0:1788201206.219505:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201206.540167:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622487296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201206.540241:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201206.540689:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622487296 00000100:00100000:1.0:1788201206.540697:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622487296 00000100:00100000:1.0:1788201206.540754:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201206.540763:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004062c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622487296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201206.540797:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201206.540849:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004062c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622487296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201206.540856:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201206.540896:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622487296:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788201206.859444:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788201206.859455:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788201206.859501:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788201206.859507:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788201206.859637:0:11684:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b000673d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875064622487424:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788201206.859754:0:11684:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00100b43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201206.873727:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201206.876238:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614103552 00000100:00100000:2.0:1788201206.876253:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614103552 00000100:00100000:2.0:1788201206.876324:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 171 00000100:00100000:2.0:1788201206.876334:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:11504:x1875064614103552:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788201206.876371:0:5829:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788201206.876507:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:11504:x1875064614103552:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 173us (2788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201206.876516:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 171 00000100:00100000:2.0:1788201206.879198:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201206.879327:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614103680 00000100:00100000:2.0:1788201206.879337:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614103680 00000100:00100000:2.0:1788201206.879394:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 172 00000100:00100000:2.0:1788201206.879405:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:11504:x1875064614103680:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788201206.879494:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7876be lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879511:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7876be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879524:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7876be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879538:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7876c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879545:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7876c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879551:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7876c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879577:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7876cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879585:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7876cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879591:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7876cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201206.879628:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788201206.879632:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201206.879646:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7876cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879657:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7876be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879669:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7876be lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879687:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7876be lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879694:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201206.879697:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7876be lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879781:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7876be lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879795:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b0011cb3e00) 00010000:00010000:2.0:1788201206.879798:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201206.879802:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7876be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879808:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b7876be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879820:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7876c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879825:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7876c5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879830:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7876c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879835:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201206.879844:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7876c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879850:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7876c5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879858:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9b0011cb3100) 00010000:00010000:2.0:1788201206.879860:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201206.879863:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7876c5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879868:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7876c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879881:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7876cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879886:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7876cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879891:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7876cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879896:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201206.879898:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7876cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879903:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7876cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879909:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0002a80e00) 00010000:00010000:2.0:1788201206.879911:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201206.879919:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7876cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.879924:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7876cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201206.879991:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:11504:x1875064614103680:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 Request processed in 588us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201206.879999:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 172 00000100:00100000:1.0:1788201206.880080:0:11684:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b000673d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875064622487424:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788201206.887043:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201206.887193:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614103936 00000100:00100000:1.0:1788201206.887203:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614103936 00000100:00100000:1.0:1788201206.887262:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 173 00000100:00100000:1.0:1788201206.887272:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+34:11504:x1875064614103936:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201206.887293:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201206.887314:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7876d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2fd8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.887409:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7876da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.887424:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7876da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.887436:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7876da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201206.887449:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788201206.888030:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7876da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.888040:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7876da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.888047:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7876da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.888054:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201206.888065:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7876da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.888072:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7876da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.888085:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0002a80e00) 00010000:00010000:1.0:1788201206.888088:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201206.888092:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7876da lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.888097:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7876da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.888165:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7876d3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fd8 expref: 36 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.888176:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b0011cb3e00) 00010000:00010000:1.0:1788201206.888179:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201206.888183:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b7876d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fd8 expref: 36 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.888193:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680000, rc 0) 00000100:00100000:1.0:1788201206.888255:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:11504:x1875064614103936:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 984us (1219us total) trans 4294967458 rc 301/301 00000100:00100000:1.0:1788201206.888263:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 173 00000100:00100000:2.0:1788201206.906745:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201206.909550:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614104064 00000100:00100000:1.0:1788201206.909574:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614104064 00000100:00100000:1.0:1788201206.909628:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 174 00000100:00100000:1.0:1788201206.909639:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:11504:x1875064614104064:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788201206.909690:0:5827:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788201206.909809:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:11504:x1875064614104064:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 171us (3073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201206.909817:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 174 00000100:00100000:3.0:1788201206.913860:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201206.913895:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614104320 00000100:00100000:3.0:1788201206.913903:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614104320 00000100:00100000:3.0:1788201206.913951:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 175 00000100:00100000:3.0:1788201206.913961:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:11504:x1875064614104320:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201206.913987:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201206.913990:0:9471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788201206.914017:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787694 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fca expref: 35 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.914034:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:3.0:1788201206.914039:0:9471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201206.914051:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7876e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2fdf expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201206.917024:0:9471:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788201206.917315:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7876ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.917333:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7876ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.917345:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7876ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.917413:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7876e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fdf expref: 37 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.917452:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7876ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fdf expref: 36 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.917461:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b00109a1300) 00010000:00010000:3.0:1788201206.917464:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201206.917468:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000031800, rc 0) 00000100:00100000:3.0:1788201206.924355:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+36:11504:x1875064614104320:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 10386us (10493us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788201206.924368:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 175 00000100:00100000:2.0:1788201206.947848:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201206.947935:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614104576 00000100:00100000:3.0:1788201206.947945:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614104576 00000100:00100000:3.0:1788201206.947996:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 176 00000100:00100000:3.0:1788201206.948006:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+36:11504:x1875064614104576:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788201206.948062:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201206.948087:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7876ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fdf expref: 36 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948108:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b00109a1300) 00010000:00010000:3.0:1788201206.948119:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201206.948164:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7876fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948178:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7876fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948188:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7876fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948208:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787704 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1f476e7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948216:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787704 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1f476e7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948223:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787704 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1f476e7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948471:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7876fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948479:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7876fd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948485:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7876fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948492:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201206.948496:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7876fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948504:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7876fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948513:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:3.0:1788201206.948516:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.948519:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7876fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948538:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7876fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948554:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787704 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1f476e7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948561:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787704 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1f476e7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948567:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787704 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1f476e7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948572:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201206.948575:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787704 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1f476e7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948581:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787704 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1f476e7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948589:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1f476e7a (ffff9b00109a1c00) 00010000:00010000:3.0:1788201206.948591:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.948594:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787704 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1f476e7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.948601:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787704 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1f476e7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201206.948681:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:11504:x1875064614104576:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 667us (833us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201206.948689:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 176 00000100:00100000:0.0:1788201206.954225:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201206.954350:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614104704 00000100:00100000:3.0:1788201206.954361:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614104704 00000100:00100000:3.0:1788201206.954423:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 177 00000100:00100000:3.0:1788201206.954443:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:11504:x1875064614104704:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201206.954465:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201206.954488:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b78770b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2fe6 expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.954525:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787712 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.954538:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.954548:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.954640:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b78770b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fe6 expref: 37 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.954661:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787712 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fe6 expref: 36 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.954670:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b00109a1d00) 00010000:00010000:3.0:1788201206.954686:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788201206.954689:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000031000, rc 0) 00000100:00100000:3.0:1788201206.954745:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+36:11504:x1875064614104704:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 305us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201206.954752:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 177 00000100:00100000:3.0:1788201206.967305:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201206.967375:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614104960 00000100:00100000:0.0:1788201206.967386:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614104960 00000100:00100000:0.0:1788201206.967447:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 178 00000100:00100000:0.0:1788201206.967457:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+36:11504:x1875064614104960:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788201206.967536:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787719 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.967563:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787719 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.967574:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787719 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201206.967904:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1788201206.967915:0:5827:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 286092780936ns, next at 287092777912ns, rc = 0 00000004:00010000:0.0:1788201206.968003:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5821636 reply state 00000000f861e474 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787719 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201206.968031:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201206.968123:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+38:11504:x1875064614104960:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 666us (828us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788201206.968157:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 178 00000040:00080000:1.0:1788201206.971651:0:12506:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788201206.971662:0:12506:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788201206.972812:0:12506:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788201206.972821:0:12506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788201206.973425:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787719 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.973437:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787719 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.973445:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787719 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.973452:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676fa00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201206.973457:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787719 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.973476:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787719 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.973493:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b00109a1d00) 00010000:00010000:0.0:1788201206.973496:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201206.973501:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787719 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.973506:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787719 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201206.979653:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201206.979885:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614105088 00000100:00100000:0.0:1788201206.979894:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614105088 00000100:00100000:0.0:1788201206.979956:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 179 00000100:00100000:0.0:1788201206.979966:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+37:11504:x1875064614105088:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201206.979988:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201206.980008:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b787720 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2fed expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.980066:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b787720 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fed expref: 38 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.980081:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b787720 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fed expref: 38 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.980100:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b00109a1d00) 00010000:00010000:0.0:1788201206.980103:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201206.980106:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676fe00, rc 0) 00000100:00100000:0.0:1788201206.980187:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+38:11504:x1875064614105088:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 222us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201206.980193:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 179 00000100:00100000:2.0:1788201206.989960:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201206.990038:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614105216 00000100:00100000:1.0:1788201206.990047:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614105216 00000100:00100000:1.0:1788201206.990118:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00100000:1.0:1788201206.990129:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2348:x1875064614105216:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788201206.990635:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2348:x1875064614105216:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 507us (683us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788201206.990643:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00080000:2.0:1788201206.990774:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201207.011841:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201207.012185:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614105472 00000100:00100000:0.0:1788201207.012194:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614105472 00000100:00100000:0.0:1788201207.012252:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:0.0:1788201207.012261:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+38:11504:x1875064614105472:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788201207.012476:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+39:11504:x1875064614105472:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 216us (644us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788201207.012483:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00080000:2.0:1788201207.013289:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201207.020354:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201207.020439:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614105728 00000100:00100000:2.0:1788201207.020449:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614105728 00000100:00100000:2.0:1788201207.020548:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 180 00000100:00100000:2.0:1788201207.020559:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+39:11504:x1875064614105728:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788201207.020682:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+39:11504:x1875064614105728:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 114us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201207.020691:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 180 00000100:00100000:0.0:1788201207.026126:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201207.026304:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614105856 00000100:00100000:3.0:1788201207.026314:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614105856 00000100:00100000:3.0:1788201207.026371:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 181 00000100:00100000:3.0:1788201207.026383:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+39:11504:x1875064614105856:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201207.026417:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201207.026440:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787727 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2ff4 expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.026509:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b78772e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.026524:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b78772e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.026535:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b78772e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201207.026571:0:9471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201207.026590:0:9471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b78772e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.026615:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787727 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ff4 expref: 41 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.026638:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b78772e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ff4 expref: 40 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.026646:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b00109a1d00) 00010000:00010000:3.0:1788201207.026649:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788201207.026660:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000030800, rc 0) 00000100:00100000:3.0:1788201207.026732:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+40:11504:x1875064614105856:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 351us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201207.026739:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 181 00000100:00100000:3.0:1788201207.034524:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201207.034669:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614105984 00000100:00100000:2.0:1788201207.034687:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614105984 00000100:00100000:2.0:1788201207.034894:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:2.0:1788201207.034906:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2348:x1875064614105984:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201207.034924:0:7765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201207.034943:0:7765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026b70207/0x72011f792b787735 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d2ffb expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201207.034976:0:7765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95c8f6, blocks: 0x1 00010000:00010000:2.0:1788201207.034994:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=286s v=(0 0) 00010000:00010000:2.0:1788201207.034998:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201207.035007:0:7765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026b70207/0x72011f792b787735 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ffb expref: 8 pid: 7765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.035025:0:7765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000026b70207/0x72011f792b787735 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ffb expref: 8 pid: 7765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.035037:0:7765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0200, rc 0) 00000100:00100000:2.0:1788201207.035091:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2348:x1875064614105984:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 188us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201207.035098:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:2.0:1788201207.042353:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201207.042978:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614106240 00000100:00100000:3.0:1788201207.042987:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614106240 00000100:00100000:3.0:1788201207.043105:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 182 00000100:00100000:3.0:1788201207.043115:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+40:11504:x1875064614106240:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788201207.043253:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+40:11504:x1875064614106240:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 139us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201207.043260:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 182 00000100:00100000:1.0:1788201207.058984:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201207.059130:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614106368 00000100:00100000:0.0:1788201207.059162:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614106368 00000100:00100000:0.0:1788201207.059209:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:0.0:1788201207.059219:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000673d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:11504:x1875064614106368:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201207.059237:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201207.059253:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c7edb0c/0x72011f792b78773c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3002 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.059283:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000026b70207/0x72011f792b787735 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ffb expref: 9 pid: 7765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.059293:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201207.059298:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201207.059303:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c7edb0c/0x72011f792b78773c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3002 expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.059335:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000026b70207/0x72011f792b787735 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ffb expref: 9 pid: 7765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.059348:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000026b70207/0x72011f792b787735 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ffb expref: 9 pid: 7765 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201207.059361:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6678:1875064622487552:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788201207.059441:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003b3ba6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201207.081022:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201207.081214:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6678:1875064622487552:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201207.081246:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002c7edb0c/0x72011f792b78773c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3002 expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.081267:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676e200, rc 0) 00000100:00100000:1.0:1788201207.081860:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000673d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:11504:x1875064614106368:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 22640us (22883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201207.081870:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:2.0:1788201207.081957:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614106496 00000100:00100000:2.0:1788201207.081965:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614106496 00010000:00010000:2.0:1788201207.081996:0:6691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000026b70207/0x72011f792b787735 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ffb expref: 9 pid: 7765 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201207.082033:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:2.0:1788201207.082042:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:2348:x1875064614106496:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201207.082055:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201207.082075:0:6691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000026b70207/0x72011f792b787735 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ffb expref: 9 pid: 7765 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.082104:0:6691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000026b70207/0x72011f792b787735 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ffb expref: 9 pid: 7765 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.082126:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026b70207/0x72011f792b787735 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ffb expref: 9 pid: 7765 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.082156:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201207.082161:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201207.082169:0:6691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002c7edb0c/0x72011f792b78773c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3002 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.082181:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c7edb0c/0x72011f792b78773c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3002 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.082214:0:6691:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002c7edb0c/0x72011f792b78773c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3002 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201207.082228:0:6691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040424700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6691:1875064622487680:192.168.203.14@tcp:105: 00000100:00100000:2.0:1788201207.082289:0:6691:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8e43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201207.098347:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201207.099078:0:6691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040424700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6691:1875064622487680:192.168.203.14@tcp:105: 00010000:00010000:1.0:1788201207.099109:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201207.099183:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2348:x1875064614106496:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 17142us (18174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201207.099193:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:0.0:1788201207.100332:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614106624 00000100:00100000:0.0:1788201207.100349:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614106624 00002000:00100000:0.0:1788201207.100399:0:6681:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9b0040426300 x1875064614106624/t0(0) o4->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:328/0 lens 504/0 e 0 to 0 dl 1788201218 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201207.100410:0:6681:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0040426300 with x1875064614106624 ext(0->8) 00002000:00010000:0.0:1788201207.100415:0:6681:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b0040426300 00000100:00100000:0.0:1788201207.100441:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:0.0:1788201207.100452:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2349:x1875064614106624:12345-192.168.203.14@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788201207.100870:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+10:2349:x1875064614106624:12345-192.168.203.14@tcp:4:lhsmtool_posix.0 Request processed in 419us (2527us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788201207.100878:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00002000:00100000:0.0:1788201207.100885:0:6681:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9b0040426300 x1875064614106624/t4294967314(0) o4->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:328/0 lens 504/448 e 0 to 0 dl 1788201218 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201207.100895:0:6681:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0040426300 with x1875064614106624 ext(0->8) 00002000:00010000:0.0:1788201207.100899:0:6681:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b0040426300 00000100:00100000:2.0:1788201207.112422:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201207.114803:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614106752 00000100:00100000:3.0:1788201207.114826:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614106752 00000100:00100000:3.0:1788201207.114889:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 183 00000100:00100000:3.0:1788201207.114899:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+40:11504:x1875064614106752:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788201207.167342:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+40:11504:x1875064614106752:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 Request processed in 52433us (54918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201207.167356:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 183 00000001:00080000:0.0:1788201207.167834:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:0.0:1788201207.167846:0:5849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788201207.167884:0:5849:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1788201207.167958:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788201207.167974:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788201207.168253:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201207.168710:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0040424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622487808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788201207.168764:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201207.168916:0:12066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622487808 00000100:00100000:0.0:1788201207.168924:0:12066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622487808 00000100:00100000:0.0:1788201207.169017:0:12066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788201207.169027:0:12066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622487808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788201207.169229:0:12066:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788201207.169234:0:12066:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788201206 00002000:00010000:0.0:1788201207.169236:0:12066:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788201207.169239:0:12066:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788201206 -> 1788201206 00002000:00010000:0.0:1788201207.169241:0:12066:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:1.0:1788201207.169496:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0040424700/2, rc 0, transno 4294967315 00000100:00100000:1.0:1788201207.169503:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0040424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622487808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788201207.169544:0:12066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3295:x1875064622487808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 518us (778us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788201207.169551:0:12066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788201207.169716:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201207.174037:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201207.174550:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614106880 00000100:00100000:2.0:1788201207.174559:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614106880 00000100:00100000:2.0:1788201207.174613:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 55 00000100:00100000:2.0:1788201207.174637:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+10:2348:x1875064614106880:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788201207.219537:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+10:2348:x1875064614106880:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 Request processed in 44893us (45499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201207.219550:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 55 00000001:00080000:1.0:1788201207.220520:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1788201207.220534:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1788201207.222647:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201207.223199:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614107136 00000100:00100000:3.0:1788201207.223210:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614107136 00000100:00100000:3.0:1788201207.223286:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 184 00000100:00100000:3.0:1788201207.223295:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+18:11504:x1875064614107136:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788201207.223350:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201207.223376:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b78772e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ff4 expref: 18 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.223399:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b00109a1d00) 00010000:00010000:3.0:1788201207.223403:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201207.223430:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787743 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.223443:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787743 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.223451:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787743 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201207.223705:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050aadd39 reply state 00000000600ed299 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787743 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201207.223724:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201207.223815:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:11504:x1875064614107136:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 521us (1177us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788201207.223823:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 184 00000100:00100000:3.0:1788201207.226752:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00010000:00010000:3.0:1788201207.226785:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787743 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.226795:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787743 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.226818:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787743 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.226824:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201207.226829:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787743 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.226836:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787743 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.226851:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b00109a1d00) 00010000:00010000:3.0:1788201207.226854:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201207.226858:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787743 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.226865:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787743 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201207.226904:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614107264 00000100:00100000:3.0:1788201207.226911:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614107264 00000100:00100000:3.0:1788201207.226951:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 56 00000100:00100000:3.0:1788201207.226958:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2351:x1875064614107264:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788201207.227317:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788201207.227321:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788201206 -> 1788201205 00002000:00010000:3.0:1788201207.227324:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788201204 00002000:00010000:3.0:1788201207.227326:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788201206 -> 1788201205 00002000:00010000:3.0:1788201207.227329:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788201207.227372:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2351:x1875064614107264:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 414us (627us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788201207.227385:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 56 00000100:00100000:2.0:1788201207.230067:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201207.230163:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614107520 00000100:00100000:0.0:1788201207.230172:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614107520 00000100:00100000:0.0:1788201207.230220:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 185 00000100:00100000:0.0:1788201207.230230:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+18:11504:x1875064614107520:12345-192.168.203.14@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788201207.230296:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78774a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.230314:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787712 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fe6 expref: 18 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.230323:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78774a lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.230356:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787712 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fe6 expref: 18 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.230369:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787712 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fe6 expref: 18 pid: 9471 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201207.230383:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5829:1875064622487936:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788201207.230481:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003b3ba3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201207.233604:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201207.233637:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614107648 00000100:00100000:0.0:1788201207.233645:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614107648 00010000:00010000:0.0:1788201207.233693:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787712 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fe6 expref: 19 pid: 9471 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201207.233736:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 70 00000100:00100000:0.0:1788201207.233746:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:2348:x1875064614107648:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201207.233759:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201207.233766:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787712 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fe6 expref: 19 pid: 9471 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.233779:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787712 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fe6 expref: 19 pid: 9471 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.233799:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b00109a1d00) 00010000:00010000:0.0:1788201207.233804:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78774a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.233815:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78774a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.233823:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78774a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.233840:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201207.233879:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:2348:x1875064614107648:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 134us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201207.233886:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 70 00010000:00010000:3.0:1788201207.233989:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b787712 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fe6 expref: 18 pid: 9471 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201207.234011:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5829:1875064622487936:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788201207.234029:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78774a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.234045:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78774a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.234051:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78774a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.234079:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78774a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.234086:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78774a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.234092:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78774a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.234098:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676fc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201207.234101:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78774a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.234108:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78774a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.234129:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b00109a1d00) 00010000:00010000:3.0:1788201207.234164:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788201207.234169:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78774a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.234175:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78774a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201207.234218:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+17:11504:x1875064614107520:12345-192.168.203.14@tcp:55:lhsmtool_posix.0 Request processed in 3990us (4160us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788201207.234226:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 185 00000100:00100000:3.0:1788201207.237609:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201207.237696:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614107776 00000100:00100000:1.0:1788201207.237705:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614107776 00000100:00100000:1.0:1788201207.237762:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:1.0:1788201207.237772:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2351:x1875064614107776:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788201207.237813:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b787751 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.237831:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c7edb0c/0x72011f792b78773c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3002 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.237840:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201207.237844:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201207.237849:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b787751 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.237880:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c7edb0c/0x72011f792b78773c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3002 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.237912:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c7edb0c/0x72011f792b78773c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3002 expref: 8 pid: 6678 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201207.237927:0:6675:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b00066de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6675:1875064622488064:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201207.238003:0:6675:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00100b4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201207.240998:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201207.241031:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614107904 00000100:00100000:3.0:1788201207.241045:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614107904 00010000:00010000:3.0:1788201207.241084:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c7edb0c/0x72011f792b78773c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3002 expref: 9 pid: 6678 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201207.241121:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 71 00000100:00100000:3.0:1788201207.241131:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:2349:x1875064614107904:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201207.241167:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201207.241189:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c7edb0c/0x72011f792b78773c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3002 expref: 9 pid: 6678 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.241202:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c7edb0c/0x72011f792b78773c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3002 expref: 9 pid: 6678 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.241246:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201207.241251:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201207.241256:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b787751 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.241267:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b787751 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.241286:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201207.241332:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:2349:x1875064614107904:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 203us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201207.241339:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 71 00010000:00010000:1.0:1788201207.242054:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c7edb0c/0x72011f792b78773c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3002 expref: 8 pid: 6678 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201207.242072:0:6675:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b00066de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6675:1875064622488064:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201207.242093:0:6675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b787751 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.242103:0:6675:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b787751 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.242110:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b787751 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.242162:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b787751 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.242171:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b787751 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.242192:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b787751 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.242199:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680000 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201207.242202:0:6675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b787751 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.242211:0:6675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b787751 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.242224:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b787751 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.242231:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000150c751a/0x72011f792b787751 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201207.242341:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2351:x1875064614107776:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 Request processed in 4569us (4740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201207.242350:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 57 00010000:00010000:2.0:1788201207.243978:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201207.246908:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201207.247008:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614108160 00000100:00100000:0.0:1788201207.247017:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614108160 00000100:00100000:0.0:1788201207.247222:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 186 00000100:00100000:0.0:1788201207.247232:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+17:11504:x1875064614108160:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788201207.247309:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787758 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.247326:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.247337:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.247541:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78775f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.247553:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b787720 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fed expref: 18 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.247561:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78775f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.247591:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b787720 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fed expref: 18 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.247603:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b787720 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fed expref: 18 pid: 9471 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201207.247618:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5827:1875064622488192:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788201207.247735:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003b3ba0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201207.251067:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201207.251170:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614108288 00000100:00100000:1.0:1788201207.251178:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614108288 00010000:00010000:1.0:1788201207.251215:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b787720 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fed expref: 19 pid: 9471 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201207.251252:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 72 00000100:00100000:1.0:1788201207.251269:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:2348:x1875064614108288:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201207.251283:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201207.251290:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b787720 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fed expref: 19 pid: 9471 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.251303:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b787720 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fed expref: 19 pid: 9471 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.251325:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b00109a1d00) 00010000:00010000:1.0:1788201207.251330:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78775f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.251339:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78775f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.251346:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78775f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201207.251365:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201207.251408:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:2348:x1875064614108288:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 141us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201207.251415:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 72 00010000:00010000:2.0:1788201207.251510:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b787720 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fed expref: 18 pid: 9471 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201207.251527:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5827:1875064622488192:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788201207.251545:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78775f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.251554:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78775f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.251560:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78775f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201207.251751:0:5827:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1788201207.251890:0:5827:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1788201207.251933:0:5827:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788201207.252020:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003fad0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5827:1875064622488320:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788201207.252070:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201207.252103:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000a759540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201207.252179:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622488320 00000100:00100000:1.0:1788201207.252184:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622488320 00000100:00100000:1.0:1788201207.252211:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201207.252218:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5827:x1875064622488320:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788201207.252281:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5827:x1875064622488320:12345-0@lo:1000:mdt00_000.0 Request processed in 63us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201207.252288:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201207.252473:0:5827:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788201207.252478:0:5827:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0040424700, transno 4294967315 00000100:00100000:2.0:1788201207.252497:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003fad0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5827:1875064622488320:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788201207.252924:0:5827:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1788201207.252976:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003fad0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5827:1875064622488448:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788201207.253006:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201207.253076:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000a759780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201207.255030:0:12067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622488448 00000100:00100000:1.0:1788201207.255108:0:12067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622488448 00000100:00100000:1.0:1788201207.255296:0:12067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201207.255307:0:12067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5827:x1875064622488448:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788201207.255569:0:12067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5827:x1875064622488448:12345-0@lo:1000:mdt00_000.0 Request processed in 264us (2562us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788201207.255578:0:12067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201207.255646:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003fad0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5827:1875064622488448:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788201207.255695:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78775f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.255706:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78775f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.255714:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78775f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.255721:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676ee00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201207.255725:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78775f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.255733:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78775f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.255749:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b00109a1d00) 00010000:00010000:2.0:1788201207.255752:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201207.255757:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78775f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.255763:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78775f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.255791:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b78769b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.255798:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b78769b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.255804:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b78769b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.255822:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201207.255825:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b78769b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.255832:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b78769b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.255840:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0002a80e00) 00010000:00010000:2.0:1788201207.255843:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201207.255846:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b78769b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.255852:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b78769b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.255877:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787766 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.255891:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7876b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fd1 expref: 21 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.255899:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787766 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.255929:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7876b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fd1 expref: 21 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.255943:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7876b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fd1 expref: 21 pid: 5827 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201207.255967:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003fad0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5827:1875064622488576:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788201207.256048:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000a759780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201207.259108:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201207.259160:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614108416 00000100:00100000:2.0:1788201207.259168:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614108416 00010000:00010000:2.0:1788201207.259203:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7876b7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fd1 expref: 22 pid: 5827 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201207.259235:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 73 00000100:00100000:2.0:1788201207.259243:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:2349:x1875064614108416:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201207.259256:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201207.259263:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7876b7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fd1 expref: 22 pid: 5827 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.259275:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7876b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fd1 expref: 22 pid: 5827 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.259296:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0002a80e00) 00010000:00010000:2.0:1788201207.259301:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787766 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.259312:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.259319:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787766 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201207.259355:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201207.259405:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:2349:x1875064614108416:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 161us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201207.259413:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 73 00010000:00010000:3.0:1788201207.259597:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b7876b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2fd1 expref: 21 pid: 5827 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201207.259615:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003fad0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5827:1875064622488576:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788201207.259632:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.259641:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.259648:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.259680:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.259687:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787766 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.259695:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787766 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.259701:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201207.259705:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787766 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.259713:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787766 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.259721:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0002a80e00) 00010000:00010000:3.0:1788201207.259724:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201207.259727:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787766 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.259733:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787766 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.259743:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.259750:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787758 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.259755:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787758 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.259767:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201207.259770:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787758 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.259776:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787758 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.259784:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b0002a80e00) 00010000:00010000:3.0:1788201207.259786:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788201207.259789:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787758 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.259794:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787758 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201207.259998:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:11504:x1875064614108160:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 12767us (13098us total) trans 4294967467 rc 0/0 00000100:00100000:3.0:1788201207.260008:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 186 00000020:00080000:3.0:1788201207.260012:0:5827:0:(tgt_main.c:807:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788201207.260440:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788201207.260446:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201207.260762:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788201207.260769:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788201207.264536:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201207.264625:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614108672 00000100:00100000:0.0:1788201207.264635:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614108672 00000100:00100000:0.0:1788201207.264700:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 50 00000100:00100000:0.0:1788201207.264711:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002289d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:11504:x1875064614108672:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788201207.266248:0:5831:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788201207.266362:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:0.0:1788201207.266412:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78776d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.266429:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78776d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.266438:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78776d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.266446:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78776d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.266453:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78776d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.266470:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78776d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201207.266526:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201207.266628:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002289d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:11504:x1875064614108672:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 1916us (2098us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1788201207.266638:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 50 00000020:00080000:0.0:1788201207.266643:0:5831:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788201207.268077:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201207.268089:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78776d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.268100:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676fa00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201207.268104:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78776d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.268114:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78776d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.268169:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b0002a80100) 00010000:00010000:3.0:1788201207.268172:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201207.268177:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78776d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.268183:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b78776d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201207.268203:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201207.268205:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201207.268207:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788201208.194611:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1788201208.194627:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:1.0:1788201208.273689:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788201208.963886:0:12561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788201208.963894:0:12561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788201208.963931:0:12561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788201208.963938:0:12561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788201209.229346:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201209.229478:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614108928 00000100:00100000:3.0:1788201209.229489:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614108928 00000100:00100000:3.0:1788201209.229560:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 187 00000100:00100000:3.0:1788201209.229571:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:11523:x1875064614108928:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788201209.229599:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201209.229628:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787774 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3009 expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788201209.229774:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788201209.229857:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b78777b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.229871:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b78777b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.229883:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b78777b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201209.229901:0:9471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1788201209.230398:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787774 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3009 expref: 25 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.230416:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b78777b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3009 expref: 24 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.230424:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:3.0:1788201209.230427:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788201209.230431:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000031000, rc 0) 00000100:00100000:3.0:1788201209.230506:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+24:11523:x1875064614108928:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 938us (1169us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788201209.230515:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 187 00000100:00100000:2.0:1788201209.241994:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201209.242847:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614109056 00000100:00100000:0.0:1788201209.242859:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614109056 00000100:00100000:0.0:1788201209.242933:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 188 00000100:00100000:0.0:1788201209.242945:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+24:11523:x1875064614109056:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:1.0:1788201209.243386:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b787789 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243405:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b787789 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243417:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b787789 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243436:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787790 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243444:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243450:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243769:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787797 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243778:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243792:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201209.243832:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243843:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b787789 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243849:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b787789 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243855:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b787789 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243861:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201209.243864:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b787789 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243872:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b787789 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243883:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:1.0:1788201209.243887:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201209.243891:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b787789 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243898:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b787789 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243910:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243923:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787790 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243929:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787790 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243933:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201209.243936:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787790 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243942:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787790 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243950:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b00033b2600) 00010000:00010000:1.0:1788201209.243952:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201209.243955:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787790 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243961:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787790 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243976:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243982:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787797 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243988:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787797 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.243993:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201209.244002:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787797 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.244009:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787797 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.244016:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00033b2c00) 00010000:00010000:1.0:1788201209.244019:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201209.244022:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787797 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.244027:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787797 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.244109:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+24:11523:x1875064614109056:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 1165us (2530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.244119:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 188 00010000:00010000:0.0:1788201209.292632:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201209.334495:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201209.334586:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614109312 00000100:00100000:3.0:1788201209.334596:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614109312 00000100:00100000:3.0:1788201209.334665:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 189 00000100:00100000:3.0:1788201209.334676:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+24:11526:x1875064614109312:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788201209.334697:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201209.334728:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b78779e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3010 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.334802:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7877a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.334816:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7877a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.334856:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7877a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.334871:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.334878:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.335246:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.335560:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.335570:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.335578:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201209.335588:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788201209.335692:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7877a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.335700:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7877a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.335706:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7877a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.335711:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201209.336344:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7877a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.336355:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7877a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.336367:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:3.0:1788201209.336370:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201209.336374:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7877a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.336379:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7877a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.336392:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.336398:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.336403:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.336408:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201209.336411:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.336416:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.336423:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b00109a1c00) 00010000:00010000:3.0:1788201209.336425:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201209.336436:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.336630:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.337536:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b78779e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3010 expref: 27 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.337560:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3010 expref: 26 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.337568:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1300) 00010000:00010000:2.0:1788201209.337571:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201209.337574:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000031800, rc 0) 00000100:00100000:2.0:1788201209.337690:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:11526:x1875064614109312:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 3015us (3202us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788201209.337699:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 189 00000100:00100000:0.0:1788201209.342549:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201209.342614:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614109440 00000100:00100000:1.0:1788201209.342625:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614109440 00000100:00100000:1.0:1788201209.342689:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 190 00000100:00100000:1.0:1788201209.342701:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:11526:x1875064614109440:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:1.0:1788201209.342774:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7877c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.342789:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7877c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.342800:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7877c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.342858:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7877c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.342864:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7877c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.342870:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7877c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.342876:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201209.342881:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7877c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.343041:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7877c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.343052:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1300) 00010000:00010000:1.0:1788201209.343055:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201209.343060:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7877c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.343066:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b7877c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.343165:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:11526:x1875064614109440:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 467us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.343173:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 190 00000100:00100000:3.0:1788201209.346832:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201209.347351:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614109696 00000100:00100000:1.0:1788201209.347361:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614109696 00000100:00100000:1.0:1788201209.347411:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00100000:1.0:1788201209.347433:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:11526:x1875064614109696:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788201209.347683:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:11526:x1875064614109696:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 251us (861us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788201209.347690:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00100000:2.0:1788201209.392530:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201209.392637:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614109952 00000100:00100000:0.0:1788201209.392647:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614109952 00000100:00100000:0.0:1788201209.392716:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 191 00000100:00100000:0.0:1788201209.392726:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:11052:x1875064614109952:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788201209.392752:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201209.392772:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b7877c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3017 expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.392878:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7877cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.392894:0:9471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3010 expref: 28 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.392903:0:9471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7877cf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.392945:0:9471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3010 expref: 28 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.392959:0:9471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3010 expref: 28 pid: 5829 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.392991:0:9471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f05c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9471:1875064622488704:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788201209.393090:0:9471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003b3ba240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.396217:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201209.396296:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614110080 00000100:00100000:1.0:1788201209.396305:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614110080 00010000:00010000:1.0:1788201209.396343:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877b3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3010 expref: 29 pid: 5829 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.396385:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 74 00000100:00100000:1.0:1788201209.396394:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+29:2348:x1875064614110080:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.396407:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.396413:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877b3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3010 expref: 29 pid: 5829 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.396425:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3010 expref: 29 pid: 5829 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.396457:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1300) 00010000:00010000:1.0:1788201209.396462:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7877cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.396473:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7877cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.396481:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7877cf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.396519:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.396578:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+29:2348:x1875064614110080:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 184us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.396586:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 74 00010000:00010000:3.0:1788201209.397068:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3010 expref: 28 pid: 5829 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.397086:0:9471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f05c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9471:1875064622488704:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788201209.397107:0:9471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7877cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.397115:0:9471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7877cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.397121:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7877cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201209.397176:0:9471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788201209.397322:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b7877c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3017 expref: 29 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.397336:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7877cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3017 expref: 28 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.397343:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1300) 00010000:00010000:3.0:1788201209.397347:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788201209.397349:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676f000, rc 0) 00000100:00100000:3.0:1788201209.398258:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:11052:x1875064614109952:12345-192.168.203.14@tcp:101:bash.0 Request processed in 5529us (5732us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1788201209.398267:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 191 00000100:00100000:0.0:1788201209.410022:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201209.410537:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614110336 00000100:00100000:2.0:1788201209.410547:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614110336 00000100:00100000:2.0:1788201209.410618:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 192 00000100:00100000:2.0:1788201209.410629:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:11052:x1875064614110336:12345-192.168.203.14@tcp:36:bash.0 00010000:00010000:2.0:1788201209.411651:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7877dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.411680:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7877dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.411692:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7877dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201209.411756:0:5828:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:2.0:1788201209.411780:0:5828:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d03b9020 reply state 0000000077e86046 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7877dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.411788:0:5828:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788201209.411834:0:5828:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:2.0:1788201209.413124:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:11052:x1875064614110336:12345-192.168.203.14@tcp:36:bash.0 Request processed in 2487us (3101us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788201209.413160:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 192 00000020:00080000:2.0:1788201209.413168:0:5828:0:(tgt_main.c:807:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788201209.418256:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7877dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.418274:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7877dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.418281:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7877dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.418288:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201209.418293:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7877dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.418300:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7877dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.418316:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1300) 00010000:00010000:0.0:1788201209.418320:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201209.418324:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7877dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.418330:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7877dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.437644:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201209.438282:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614110464 00000100:00100000:2.0:1788201209.438292:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614110464 00000100:00100000:2.0:1788201209.438350:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 193 00000100:00100000:2.0:1788201209.438360:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:11052:x1875064614110464:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:2.0:1788201209.438383:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201209.438404:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7877e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d301e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.438461:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7877e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d301e expref: 32 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.438489:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7877e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d301e expref: 32 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.438509:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1300) 00010000:00010000:2.0:1788201209.438512:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201209.438516:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0000, rc 0) 00000100:00100000:2.0:1788201209.438577:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:11052:x1875064614110464:12345-192.168.203.14@tcp:101:bash.0 Request processed in 219us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.438584:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 193 00000100:00100000:2.0:1788201209.446419:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201209.446509:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614110592 00000100:00100000:0.0:1788201209.446519:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614110592 00000100:00100000:0.0:1788201209.446590:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 58 00000100:00100000:0.0:1788201209.446600:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:11052:x1875064614110592:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788201209.446619:0:7765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201209.446640:0:7765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065bd2276/0x72011f792b7877eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3025 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201209.446680:0:7765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a95c8f5, atime: 0x6a95c8f4, ctime: 0x6a95c8f5, blocks: 0xb 00010000:00010000:0.0:1788201209.446701:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=288s v=(0 0) 00010000:00010000:0.0:1788201209.446707:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.446716:0:7765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065bd2276/0x72011f792b7877eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3025 expref: 8 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.446731:0:7765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065bd2276/0x72011f792b7877eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3025 expref: 8 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.446745:0:7765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676f400, rc 0) 00000100:00080000:2.0:1788201209.446899:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201209.446977:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:11052:x1875064614110592:12345-192.168.203.14@tcp:101:bash.0 Request processed in 378us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201209.446985:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 58 00000100:00100000:0.0:1788201209.453838:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201209.453987:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614110720 00000100:00100000:3.0:1788201209.453997:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614110720 00002000:00010000:3.0:1788201209.454050:0:6683:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788201209.454056:0:6683:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0035f05500 with x1875064614110720 ext(0->18446744073709551615) 00002000:00010000:3.0:1788201209.454067:0:6683:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b0035f05500. 00000100:00100000:3.0:1788201209.454101:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:3.0:1788201209.454111:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2348:x1875064614110720:12345-192.168.203.14@tcp:10:bash.0 00002000:00010000:3.0:1788201209.454401:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788201209.454405:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788201205 -> 1788201209 00002000:00010000:3.0:1788201209.454408:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788201204 -> 1788201204 00002000:00010000:3.0:1788201209.454409:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788201205 -> 1788201209 00002000:00010000:3.0:1788201209.454411:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788201209.454463:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:2348:x1875064614110720:12345-192.168.203.14@tcp:10:bash.0 Request processed in 353us (634us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788201209.454469:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00002000:00010000:3.0:1788201209.454472:0:6683:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788201209.454475:0:6683:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0035f05500 with x1875064614110720 ext(0->18446744073709551615) 00002000:00010000:3.0:1788201209.454479:0:6683:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b0035f05500. 00000100:00100000:1.0:1788201209.568330:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201209.568411:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614110848 00000100:00100000:3.0:1788201209.568420:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614110848 00000100:00100000:3.0:1788201209.568488:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 194 00000100:00100000:3.0:1788201209.568498:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:11540:x1875064614110848:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:3.0:1788201209.568573:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.568603:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.568615:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.568630:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.568637:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.568644:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.573856:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787800 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.573881:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575062:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201209.575117:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575129:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575150:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575157:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575163:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000031800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201209.575167:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575174:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575186:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:0.0:1788201209.575188:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201209.575192:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575198:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b7877f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575215:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575225:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575231:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575236:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201209.575238:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575244:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575251:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b00109a1c00) 00010000:00010000:0.0:1788201209.575254:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201209.575256:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575262:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b7877f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575277:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575282:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787800 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575288:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787800 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575293:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676fa00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201209.575300:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787800 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575306:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787800 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575313:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1300) 00010000:00010000:0.0:1788201209.575315:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201209.575317:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787800 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.575323:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787800 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.575413:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:11540:x1875064614110848:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 6912us (7088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201209.575422:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 194 00000100:00100000:0.0:1788201209.627961:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201209.628005:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201209.628054:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201209.628199:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614111232 00000100:00100000:2.0:1788201209.628209:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614111232 00000100:00100000:2.0:1788201209.628278:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 142 00000100:00100000:2.0:1788201209.628289:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2350:x1875064614111232:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201209.628361:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2350:x1875064614111232:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 74us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.628368:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 142 00000100:00100000:1.0:1788201209.628442:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614110976 00000100:00100000:1.0:1788201209.628446:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614110976 00000100:00100000:1.0:1788201209.628487:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 290 00000100:00100000:1.0:1788201209.628494:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2351:x1875064614110976:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201209.628521:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2351:x1875064614110976:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 28us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.628527:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 290 00000100:00100000:3.0:1788201209.629235:0:12066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614111104 00000100:00100000:3.0:1788201209.629243:0:12066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614111104 00000100:00100000:3.0:1788201209.629282:0:12066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 71 00000100:00100000:3.0:1788201209.629290:0:12066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2350:x1875064614111104:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201209.629334:0:12066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2350:x1875064614111104:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 44us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.629341:0:12066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 71 00000100:00080000:0.0:1788201209.629563:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201209.629568:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201209.637632:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201209.637919:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614111488 00000100:00100000:1.0:1788201209.637930:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614111488 00000100:00100000:1.0:1788201209.637991:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 195 00000100:00100000:1.0:1788201209.638001:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+32:11543:x1875064614111488:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788201209.638032:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201209.638054:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b787807 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d302c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638123:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78780e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638178:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78780e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638189:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78780e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638220:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787815 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638227:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638234:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638549:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b78781c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638559:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b78781c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638567:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b78781c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201209.638576:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788201209.638680:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78780e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638689:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78780e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638696:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78780e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638703:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201209.638707:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78780e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638725:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78780e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638737:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:1.0:1788201209.638739:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201209.638744:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78780e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638751:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78780e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638764:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638771:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787815 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638778:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787815 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638783:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201209.638786:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787815 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638791:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787815 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638797:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b00033b2c00) 00010000:00010000:1.0:1788201209.638800:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201209.638802:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787815 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638817:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787815 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638857:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b787807 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d302c expref: 35 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638870:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b78781c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d302c expref: 34 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.638878:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1300) 00010000:00010000:1.0:1788201209.638880:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788201209.638882:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681800, rc 0) 00000100:00100000:1.0:1788201209.638950:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+34:11543:x1875064614111488:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 950us (1327us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788201209.638957:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 195 00000100:00100000:3.0:1788201209.642336:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201209.642528:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614111616 00000100:00100000:2.0:1788201209.642536:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614111616 00000100:00100000:2.0:1788201209.642583:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 196 00000100:00100000:2.0:1788201209.642593:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+34:11543:x1875064614111616:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:2.0:1788201209.642670:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78782a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.642687:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7877cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3017 expref: 34 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.642710:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78782a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.642747:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7877cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3017 expref: 34 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.642761:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7877cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3017 expref: 34 pid: 9471 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.642775:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003fad1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5829:1875064622488832:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788201209.642868:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8e4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.651503:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003fad1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5829:1875064622488832:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788201209.651535:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78782a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.653352:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201209.653476:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614111872 00000100:00100000:0.0:1788201209.653485:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614111872 00000100:00100000:0.0:1788201209.653538:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:0.0:1788201209.653548:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:5585:x1875064614111872:12345-192.168.203.14@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788201209.653880:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+36:5585:x1875064614111872:12345-192.168.203.14@tcp:35:ldlm_bl.0 Request processed in 332us (535us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788201209.653888:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:3.0:1788201209.656835:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201209.656922:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614112000 00000100:00100000:2.0:1788201209.656930:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614112000 00010000:00010000:2.0:1788201209.656968:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7877cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3017 expref: 36 pid: 9471 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.657005:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 75 00000100:00100000:2.0:1788201209.657014:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000679b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+36:2349:x1875064614112000:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.657037:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.657044:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7877cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3017 expref: 36 pid: 9471 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.657073:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7877cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3017 expref: 36 pid: 9471 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.657094:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7877cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3017 expref: 36 pid: 9471 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.657110:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1300) 00010000:00010000:2.0:1788201209.657114:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78782a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.657124:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78782a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.657216:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78782a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.657240:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.657283:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000679b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:2349:x1875064614112000:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 270us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.657290:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 75 00010000:00010000:0.0:1788201209.657478:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78782a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.657487:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78782a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.657518:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78782a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.657525:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78782a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.657531:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78782a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.657538:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201209.657542:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78782a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.657548:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78782a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.657557:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1300) 00010000:00010000:0.0:1788201209.657559:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201209.657563:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78782a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.657569:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1600/0x72011f792b78782a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.657607:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+34:11543:x1875064614111616:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 15016us (15281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201209.657614:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 196 00000100:00100000:2.0:1788201209.667062:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201209.667164:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614112256 00000100:00100000:0.0:1788201209.667173:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614112256 00000100:00100000:0.0:1788201209.667219:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:0.0:1788201209.667229:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+34:11543:x1875064614112256:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:0.0:1788201209.667490:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:11543:x1875064614112256:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 262us (436us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788201209.667498:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:3.0:1788201209.798477:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201209.798577:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614112512 00000100:00100000:1.0:1788201209.798588:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614112512 00000100:00100000:1.0:1788201209.798663:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 197 00000100:00100000:1.0:1788201209.798673:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+35:11554:x1875064614112512:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:1.0:1788201209.798696:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201209.798724:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b787831 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3033 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.798796:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787838 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.798810:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787838 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.798832:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787838 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.798847:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78783f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.798853:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78783f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.798859:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78783f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.800854:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787846 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.800876:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.800887:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201209.800899:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788201209.800992:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787838 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.801000:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787838 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.801007:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787838 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.801013:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201209.801160:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787838 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.801169:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787838 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.801181:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:1.0:1788201209.801184:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201209.801187:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787838 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.801194:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787838 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.801210:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78783f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.801217:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78783f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.801222:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78783f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.801227:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201209.801230:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78783f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.801236:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78783f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.801243:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b00033b2c00) 00010000:00010000:1.0:1788201209.801246:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201209.801255:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78783f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.801262:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b78783f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.801315:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681a00/0x72011f792b787831 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3033 expref: 38 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.801329:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3033 expref: 37 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.801336:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1300) 00010000:00010000:1.0:1788201209.801338:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201209.801340:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681e00, rc 0) 00000100:00100000:1.0:1788201209.801484:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+37:11554:x1875064614112512:12345-192.168.203.14@tcp:101:cat.0 Request processed in 2811us (3016us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788201209.801494:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 197 00000100:00100000:3.0:1788201209.816903:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201209.817079:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614112768 00000100:00100000:0.0:1788201209.817089:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614112768 00000100:00100000:0.0:1788201209.817191:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00100000:0.0:1788201209.817201:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+37:11554:x1875064614112768:12345-192.168.203.14@tcp:35:cat.0 00000100:00100000:0.0:1788201209.817461:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+38:11554:x1875064614112768:12345-192.168.203.14@tcp:35:cat.0 Request processed in 253us (560us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788201209.817468:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00100000:2.0:1788201209.853367:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201209.855908:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614113024 00000100:00100000:3.0:1788201209.855936:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614113024 00000100:00100000:3.0:1788201209.856071:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 198 00000100:00100000:3.0:1788201209.856083:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+38:11555:x1875064614113024:12345-192.168.203.14@tcp:36:rm.0 00010000:00010000:3.0:1788201209.856155:0:9471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788201209.856182:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787846 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3033 expref: 38 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.856204:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b78781c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d302c expref: 37 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.856215:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7877e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d301e expref: 36 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.856226:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1300) 00010000:00010000:3.0:1788201209.856236:0:9471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201209.856257:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787854 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.856269:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787854 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.856277:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787854 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.856290:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78785b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.856296:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78785b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.856313:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78785b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.856636:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787862 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.856645:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787862 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.856663:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787862 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201209.857343:0:9471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1788201209.857354:0:9471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 288982219878ns, next at 289982217344ns, rc = 0 00010000:00010000:3.0:1788201209.857420:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787869 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857432:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857440:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857448:0:9471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787869 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857455:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787869 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857462:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787869 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857499:0:9471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201209.857524:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787862 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857529:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787862 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857535:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787862 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857541:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201209.857544:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787862 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857552:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787862 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857562:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1500) 00010000:00010000:3.0:1788201209.857566:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201209.857570:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787862 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857576:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787862 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857595:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787854 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857601:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787854 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857606:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787854 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857617:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201209.857620:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787854 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857626:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787854 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857635:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:3.0:1788201209.857642:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201209.857646:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787854 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.857661:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787854 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201209.857673:0:9471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000feb600f3 reply state 000000003263a801 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78785b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.857682:0:9471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201209.857780:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+37:11555:x1875064614113024:12345-192.168.203.14@tcp:36:rm.0 Request processed in 1696us (4418us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788201209.857789:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 198 00010000:00010000:2.0:1788201209.859712:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.859726:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787869 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.859737:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000031800 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:2.0:1788201209.859741:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787869 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.859765:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787869 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.859781:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b00109a1500) 00010000:00010000:2.0:1788201209.859784:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201209.859789:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787869 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.859795:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787869 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.859819:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.859821:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.859823:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201209.866292:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78785b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.866309:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78785b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.866316:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78785b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.866421:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201209.866426:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78785b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.866433:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78785b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.866458:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b00109a1900) 00010000:00010000:3.0:1788201209.866461:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201209.866466:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78785b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.866472:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78785b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.927548:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201209.927705:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614113280 00000100:00100000:0.0:1788201209.927714:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614113280 00000100:00100000:0.0:1788201209.927788:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 199 00000100:00100000:0.0:1788201209.927799:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+36:11561:x1875064614113280:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788201209.927823:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201209.927844:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787870 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d303a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.927983:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787877 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.927999:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787877 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.928030:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787877 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.928046:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78787e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.928054:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78787e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.928059:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78787e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201209.928642:0:5827:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788201209.928816:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787885 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.928827:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.928835:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.928868:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787877 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.928875:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787877 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.928883:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787877 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.928889:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201209.928901:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787877 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.928909:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787877 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.928922:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:0.0:1788201209.928925:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201209.928929:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787877 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.928936:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787877 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201209.928949:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7dbb1d6 reply state 00000000ff6b3df7 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78787e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.928958:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201209.928987:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787870 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d303a expref: 39 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.929000:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787885 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d303a expref: 38 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.929008:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201209.929011:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201209.929013:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676f200, rc 0) 00000100:00100000:0.0:1788201209.929093:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+39:11561:x1875064614113280:12345-192.168.203.14@tcp:101:bash.0 Request processed in 1295us (1553us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788201209.929101:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 199 00010000:00010000:3.0:1788201209.933934:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78787e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.933952:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78787e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.933959:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78787e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.933964:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676ee00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201209.933969:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78787e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.933977:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78787e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.934010:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b0002a80800) 00010000:00010000:3.0:1788201209.934014:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201209.934029:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78787e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.934036:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b78787e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.934069:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201209.934613:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614113408 00000100:00100000:1.0:1788201209.934623:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614113408 00000100:00100000:1.0:1788201209.934725:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:1.0:1788201209.934737:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2348:x1875064614113408:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788201209.934755:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201209.934773:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000281c057b/0x72011f792b787893 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3041 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201209.934798:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201209.934817:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=289s v=(0 0) 00010000:00010000:1.0:1788201209.934830:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.934840:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000281c057b/0x72011f792b787893 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3041 expref: 6 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.934858:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000281c057b/0x72011f792b787893 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3041 expref: 6 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.934870:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681a00, rc 0) 00000100:00100000:1.0:1788201209.934918:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2348:x1875064614113408:12345-192.168.203.14@tcp:101:bash.0 Request processed in 184us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.934925:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:2.0:1788201209.945761:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201209.945877:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614113536 00000100:00100000:0.0:1788201209.945886:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614113536 00000100:00100000:0.0:1788201209.945946:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:0.0:1788201209.945956:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:11561:x1875064614113536:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788201209.945978:0:7765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201209.946000:0:7765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6a696c4/0x72011f792b78789a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3048 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.946041:0:7765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000281c057b/0x72011f792b787893 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3041 expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.946052:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.946057:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.946062:0:7765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6a696c4/0x72011f792b78789a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3048 expref: 7 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.946095:0:7765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000281c057b/0x72011f792b787893 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3041 expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.946109:0:7765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000281c057b/0x72011f792b787893 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3041 expref: 7 pid: 6675 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.946124:0:7765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7765:1875064622488960:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788201209.946245:0:7765:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003b3ba780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.949179:0:7765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7765:1875064622488960:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788201209.949229:0:7765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a6a696c4/0x72011f792b78789a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3048 expref: 7 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.949249:0:7765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676fa00, rc 0) 00000100:00100000:0.0:1788201209.949340:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:11561:x1875064614113536:12345-192.168.203.14@tcp:101:bash.0 Request processed in 3385us (3593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201209.949349:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:1.0:1788201209.952043:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201209.952203:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614113664 00000100:00100000:0.0:1788201209.952213:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614113664 00010000:00010000:0.0:1788201209.952253:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000281c057b/0x72011f792b787893 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3041 expref: 7 pid: 6675 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.952298:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 76 00000100:00100000:0.0:1788201209.952308:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2349:x1875064614113664:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201209.952322:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201209.952345:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000281c057b/0x72011f792b787893 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3041 expref: 7 pid: 6675 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.952359:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000281c057b/0x72011f792b787893 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3041 expref: 7 pid: 6675 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.952383:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000281c057b/0x72011f792b787893 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3041 expref: 7 pid: 6675 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.952399:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.952416:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.952425:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6a696c4/0x72011f792b78789a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3048 expref: 6 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.952435:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6a696c4/0x72011f792b78789a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3048 expref: 6 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.952486:0:5812:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a6a696c4/0x72011f792b78789a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3048 expref: 6 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.952632:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5812:1875064622489088:192.168.203.14@tcp:105: 00000100:00100000:0.0:1788201209.952720:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003b3ba780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201209.956822:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201209.956898:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614113920 00000100:00100000:3.0:1788201209.956908:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614113920 00000100:00100000:3.0:1788201209.956963:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 55 00000100:00100000:3.0:1788201209.956973:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+38:11561:x1875064614113920:12345-192.168.203.14@tcp:35:bash.0 00000100:00100000:3.0:1788201209.957342:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+39:11561:x1875064614113920:12345-192.168.203.14@tcp:35:bash.0 Request processed in 369us (530us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788201209.957351:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 55 00000100:00100000:0.0:1788201209.960233:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5812:1875064622489088:192.168.203.14@tcp:105: 00010000:00010000:0.0:1788201209.960262:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201209.960431:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2349:x1875064614113664:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 8124us (8396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201209.960451:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 76 00000100:00100000:1.0:1788201210.146204:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201210.146494:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614114048 00000100:00100000:0.0:1788201210.146504:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614114048 00000100:00100000:0.0:1788201210.146569:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 200 00000100:00100000:0.0:1788201210.146580:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+39:11577:x1875064614114048:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788201210.146606:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201210.146628:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7878a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d304f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.146707:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b7878a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.146735:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b7878a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.146747:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b7878a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201210.146808:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1788201210.146812:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201210.146834:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b7878a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.146857:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7878a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d304f expref: 41 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.146875:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b7878a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d304f expref: 40 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.146884:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:0.0:1788201210.146886:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201210.146890:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676fe00, rc 0) 00000100:00100000:0.0:1788201210.146949:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+40:11577:x1875064614114048:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 372us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201210.146958:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 200 00000100:00100000:1.0:1788201210.155183:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201210.155350:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614114304 00000100:00100000:0.0:1788201210.155360:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614114304 00000100:00100000:0.0:1788201210.155418:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 201 00000100:00100000:0.0:1788201210.155428:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+40:11577:x1875064614114304:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788201210.155448:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201210.155493:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7878af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3056 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.155608:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b7878b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.155622:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b7878b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.155633:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b7878b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201210.155645:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788201210.155777:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7878af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3056 expref: 43 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.155795:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b7878b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3056 expref: 42 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.155804:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201210.155807:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201210.155810:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676e200, rc 0) 00000100:00100000:0.0:1788201210.155878:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+42:11577:x1875064614114304:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 451us (703us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788201210.155885:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 201 00000100:00100000:2.0:1788201210.163704:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201210.163789:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614114432 00000100:00100000:3.0:1788201210.163799:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614114432 00000100:00100000:3.0:1788201210.163863:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:3.0:1788201210.163872:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+42:2351:x1875064614114432:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201210.163887:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201210.163911:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b7878b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3056 expref: 42 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.163930:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:3.0:1788201210.163935:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201210.163990:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+41:2351:x1875064614114432:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 119us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201210.164010:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:2.0:1788201210.171301:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201210.171397:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614114688 00000100:00100000:0.0:1788201210.171406:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614114688 00000100:00100000:0.0:1788201210.171472:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 202 00000100:00100000:0.0:1788201210.171482:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+41:11577:x1875064614114688:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788201210.171521:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201210.171542:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7878c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d305d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.171648:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b7878cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.171672:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b7878cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.171683:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b7878cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201210.171694:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788201210.171813:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7878c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d305d expref: 44 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.171832:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b7878cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d305d expref: 43 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.171840:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201210.171843:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788201210.171847:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676fc00, rc 0) 00000100:00100000:0.0:1788201210.171909:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+43:11577:x1875064614114688:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 429us (618us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1788201210.171916:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 202 00000100:00100000:1.0:1788201210.187227:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201210.187315:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614114816 00000100:00100000:3.0:1788201210.187325:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614114816 00000100:00100000:3.0:1788201210.187379:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:3.0:1788201210.187389:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+6:2348:x1875064614114816:12345-192.168.203.14@tcp:1:lfs.0 00010000:00010000:3.0:1788201210.187432:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b7878d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.187467:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6a696c4/0x72011f792b78789a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3048 expref: 6 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.187476:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201210.187480:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201210.187485:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b7878d9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.187520:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a6a696c4/0x72011f792b78789a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3048 expref: 6 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.187534:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a6a696c4/0x72011f792b78789a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3048 expref: 6 pid: 7765 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201210.187549:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1875064622489216:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201210.187645:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0007eba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201210.195465:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1875064622489216:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788201210.195516:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b7878d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201210.196971:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201210.197069:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614114944 00000100:00100000:0.0:1788201210.197077:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614114944 00002000:00100000:0.0:1788201210.197126:0:6681:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b004044d880 x1875064614114944/t0(0) o4->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:331/0 lens 504/0 e 0 to 0 dl 1788201221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201210.197183:0:6681:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b004044d880 with x1875064614114944 ext(0->8) 00010000:00010000:0.0:1788201210.197346:0:6681:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a6a696c4/0x72011f792b78789a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3048 expref: 7 pid: 7765 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.197365:0:6681:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a6a696c4/0x72011f792b78789a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3048 expref: 7 pid: 7765 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201210.197374:0:6681:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b004044d880 00000100:00100000:0.0:1788201210.197405:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:0.0:1788201210.197415:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2348:x1875064614114944:12345-192.168.203.14@tcp:4:lfs.0 00000100:00100000:0.0:1788201210.197883:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:2348:x1875064614114944:12345-192.168.203.14@tcp:4:lfs.0 Request processed in 468us (919us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788201210.197891:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00002000:00100000:0.0:1788201210.197898:0:6681:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b004044d880 x1875064614114944/t4294967308(0) o4->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:331/0 lens 504/448 e 0 to 0 dl 1788201221 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201210.197906:0:6681:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b004044d880 with x1875064614114944 ext(0->8) 00010000:00010000:0.0:1788201210.197912:0:6681:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a6a696c4/0x72011f792b78789a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3048 expref: 9 pid: 7765 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.197924:0:6681:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a6a696c4/0x72011f792b78789a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3048 expref: 9 pid: 7765 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201210.197931:0:6681:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b004044d880 00000100:00100000:2.0:1788201210.204252:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201210.204618:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614115072 00000100:00100000:3.0:1788201210.204627:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614115072 00010000:00010000:3.0:1788201210.204678:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a6a696c4/0x72011f792b78789a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3048 expref: 9 pid: 7765 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201210.204734:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 77 00000100:00100000:3.0:1788201210.204745:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:2350:x1875064614115072:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201210.204761:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788201210.204779:0:5813:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788201210.204781:0:5813:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788201209 00002000:00010000:3.0:1788201210.204784:0:5813:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788201210 00002000:00010000:3.0:1788201210.204786:0:5813:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788201209 00010000:00010000:3.0:1788201210.204792:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a6a696c4/0x72011f792b78789a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3048 expref: 9 pid: 7765 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.204806:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a6a696c4/0x72011f792b78789a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3048 expref: 9 pid: 7765 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.204829:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6a696c4/0x72011f792b78789a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3048 expref: 9 pid: 7765 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.204845:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201210.204850:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201210.204870:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b7878d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.204881:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b7878d9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.204919:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201210.204973:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2350:x1875064614115072:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 231us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201210.204981:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 77 00010000:00010000:1.0:1788201210.205504:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b7878d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.205515:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b7878d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.205549:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b7878d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.205684:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b7878d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.205701:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b7878d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.205708:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030e00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201210.205712:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b7878d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.205722:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b7878d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.205735:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b7878d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.205743:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b7878d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201210.205809:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2348:x1875064614114816:12345-192.168.203.14@tcp:1:lfs.0 Request processed in 18419us (18589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201210.205826:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:2.0:1788201210.210383:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201210.210465:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614115328 00000100:00100000:3.0:1788201210.210474:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614115328 00000100:00100000:3.0:1788201210.210528:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 56 00000100:00100000:3.0:1788201210.210537:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002289d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+43:11577:x1875064614115328:12345-192.168.203.14@tcp:35:lfs.0 00000004:00010000:3.0:1788201210.210591:0:5830:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b7878cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d305d expref: 43 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201210.210863:0:5830:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788201210.210900:0:5830:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1788201210.211669:0:5830:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:3.0:1788201210.211741:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7878e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.211759:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787885 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d303a expref: 47 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.211768:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7878e0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.211823:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787885 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d303a expref: 47 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.211838:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787885 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d303a expref: 47 pid: 5827 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201210.211851:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5830:1875064622489344:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201210.211938:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0007eba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201210.221708:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201210.222046:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614115456 00000100:00100000:0.0:1788201210.222078:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614115456 00010000:00010000:0.0:1788201210.222116:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787885 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d303a expref: 48 pid: 5827 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201210.222195:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 78 00000100:00100000:0.0:1788201210.222204:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+48:2348:x1875064614115456:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201210.222220:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201210.222227:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787885 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d303a expref: 48 pid: 5827 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.222240:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787885 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d303a expref: 48 pid: 5827 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.222778:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201210.222786:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7878e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.222797:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7878e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.222804:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7878e0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.222823:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201210.222890:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+48:2348:x1875064614115456:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 685us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201210.222897:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 78 00010000:00010000:3.0:1788201210.224082:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787885 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d303a expref: 47 pid: 5827 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201210.224104:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5830:1875064622489344:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788201210.224178:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7878e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.224188:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7878e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.224194:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7878e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201210.224532:0:5830:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1788201210.225627:0:5830:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1788201210.225772:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5830:1875064622489472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788201210.225837:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201210.226430:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0007eba180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201210.228907:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622489472 00000100:00100000:2.0:1788201210.228922:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622489472 00000100:00100000:2.0:1788201210.229283:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201210.229305:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5830:x1875064622489472:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1788201210.229317:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201210.229434:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5830:x1875064622489472:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 142us (3596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201210.229442:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201210.229529:0:5830:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1788201210.229541:0:5830:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1788201210.229564:0:5830:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b004044c000, transno 4294967307 00000100:00100000:0.0:1788201210.229592:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5830:1875064622489472:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788201210.230115:0:5830:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1788201210.230217:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f04700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5830:1875064622489600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788201210.230259:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201210.233833:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003b3ba240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201210.233953:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622489600 00000100:00100000:1.0:1788201210.233963:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622489600 00000100:00100000:1.0:1788201210.234017:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201210.234027:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5830:x1875064622489600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788201210.235549:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5830:x1875064622489600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1517us (5282us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788201210.235793:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201210.236313:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f04700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5830:1875064622489600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788201210.236386:0:5830:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788201210.236436:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7878e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.236446:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7878e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.236453:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7878e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.236459:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201210.236464:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7878e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.236471:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7878e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.236486:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201210.236489:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788201210.236493:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7878e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.236511:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b7878e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201210.236782:0:5830:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788201210.236862:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1788201210.236873:0:5830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 289361738910ns, next at 290361736014ns, rc = 0 00000001:00080000:0.0:1788201210.236881:0:5830:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1788201210.236917:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201210.236921:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788201210.236927:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b7878cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d305d expref: 51 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201210.237277:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002289d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+50:11577:x1875064614115328:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 26738us (26898us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788201210.237285:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 56 00000020:00080000:0.0:1788201210.237290:0:5830:0:(tgt_main.c:807:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788201210.256872:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201210.256988:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614115584 00000100:00100000:0.0:1788201210.257000:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614115584 00000100:00100000:0.0:1788201210.257064:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 203 00000100:00100000:0.0:1788201210.257085:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+50:11577:x1875064614115584:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788201210.257116:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201210.257202:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b7878e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3064 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.257271:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b7878e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3064 expref: 51 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.257304:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b7878e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3064 expref: 51 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.257325:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201210.257328:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201210.257331:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676fc00, rc 0) 00000100:00100000:0.0:1788201210.257384:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+51:11577:x1875064614115584:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 310us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201210.257391:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 203 00000100:00100000:1.0:1788201210.264712:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201210.264901:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614115840 00000100:00100000:0.0:1788201210.264911:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614115840 00000100:00100000:0.0:1788201210.264977:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:0.0:1788201210.264987:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+51:11577:x1875064614115840:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:0.0:1788201210.265257:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+52:11577:x1875064614115840:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 269us (552us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788201210.265264:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 57 00010000:00010000:3.0:1788201210.318236:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201210.419947:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201210.420271:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614115968 00000100:00100000:0.0:1788201210.420281:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614115968 00000100:00100000:0.0:1788201210.420390:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 204 00000100:00100000:0.0:1788201210.420401:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+52:11587:x1875064614115968:12345-192.168.203.14@tcp:34:lfs.0 00010000:00010000:0.0:1788201210.420482:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7878ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420500:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7878ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420529:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7878ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420547:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7878f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420554:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7878f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420560:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7878f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420675:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7878fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420683:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7878fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420690:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7878fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201210.420737:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7878fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420749:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7878ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420755:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7878ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420762:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7878ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420777:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201210.420781:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7878ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420789:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7878ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420802:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:0.0:1788201210.420805:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201210.420809:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7878ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420815:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7878ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420828:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7878f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420834:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7878f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420839:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7878f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420844:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201210.420846:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7878f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420851:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7878f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420870:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b0002a80d00) 00010000:00010000:0.0:1788201210.420872:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201210.420875:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7878f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420880:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7878f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420894:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7878fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420899:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7878fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420904:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7878fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420909:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201210.420912:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7878fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420917:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7878fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420924:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201210.420926:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201210.420928:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7878fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.420933:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b7878fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201210.421023:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+52:11587:x1875064614115968:12345-192.168.203.14@tcp:34:lfs.0 Request processed in 623us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201210.421031:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 204 00000100:00100000:2.0:1788201210.465788:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201210.465914:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614116224 00000100:00100000:0.0:1788201210.465929:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614116224 00000100:00100000:0.0:1788201210.466005:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 205 00000100:00100000:0.0:1788201210.466025:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+52:11590:x1875064614116224:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788201210.466048:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201210.466071:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787903 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d306b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466186:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b78790a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466200:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b78790a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466211:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b78790a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466225:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787911 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466231:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466237:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466583:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787918 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466592:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466600:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201210.466610:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788201210.466730:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b78790a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466738:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b78790a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466745:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b78790a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466751:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201210.466756:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b78790a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466763:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b78790a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466775:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:0.0:1788201210.466777:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201210.466782:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b78790a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466799:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b78790a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466813:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466818:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787911 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466823:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787911 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466828:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201210.466831:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787911 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466836:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787911 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466842:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b0002a80d00) 00010000:00010000:0.0:1788201210.466844:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201210.466847:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787911 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466851:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787911 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466893:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787903 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d306b expref: 55 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466907:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787918 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d306b expref: 54 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.466922:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201210.466924:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201210.466927:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676fa00, rc 0) 00000100:00100000:0.0:1788201210.467000:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+54:11590:x1875064614116224:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 987us (1232us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788201210.467008:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 205 00000100:00100000:1.0:1788201210.472933:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201210.473258:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614116352 00000100:00100000:3.0:1788201210.473268:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614116352 00000100:00100000:3.0:1788201210.473456:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 206 00000100:00100000:3.0:1788201210.473467:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+54:11590:x1875064614116352:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:3.0:1788201210.473536:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787926 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.473551:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.473561:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.473588:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.473594:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787926 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.473600:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787926 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.473605:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201210.473609:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787926 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.473615:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787926 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.473626:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:3.0:1788201210.473629:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201210.473633:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787926 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.473666:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787926 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201210.473741:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+54:11590:x1875064614116352:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 275us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201210.473749:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 206 00000100:00100000:2.0:1788201210.484544:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201210.490612:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614116608 00000100:00100000:0.0:1788201210.490625:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614116608 00000100:00100000:1.0:1788201210.494222:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 58 00000100:00100000:1.0:1788201210.494236:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+54:11590:x1875064614116608:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788201210.494473:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+55:11590:x1875064614116608:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 239us (9938us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788201210.494480:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 58 00000100:00100000:2.0:1788201210.584884:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201210.584970:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614116864 00000100:00100000:1.0:1788201210.584979:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614116864 00000100:00100000:1.0:1788201210.585045:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 207 00000100:00100000:1.0:1788201210.585054:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+55:11600:x1875064614116864:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788201210.585080:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201210.585083:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788201210.585111:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b7878a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d304f expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.585177:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:1.0:1788201210.585182:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201210.585196:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b78792d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3072 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.585294:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787934 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.585307:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787934 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.585328:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787934 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201210.585340:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788201210.585465:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b78792d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3072 expref: 57 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.585479:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787934 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3072 expref: 56 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.585487:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:1.0:1788201210.585490:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201210.585492:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681800, rc 0) 00000100:00100000:1.0:1788201210.585538:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+56:11600:x1875064614116864:12345-192.168.203.14@tcp:101:bash.0 Request processed in 485us (663us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1788201210.585544:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 207 00000100:00100000:2.0:1788201210.592304:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201210.592622:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614116992 00000100:00100000:3.0:1788201210.592632:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614116992 00000100:00100000:3.0:1788201210.592708:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:3.0:1788201210.592718:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f916a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+56:2351:x1875064614116992:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201210.592746:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201210.592772:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b787934 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3072 expref: 56 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.592790:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:3.0:1788201210.592795:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201210.592850:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f916a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+55:2351:x1875064614116992:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 133us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201210.592857:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:3.0:1788201210.593443:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201210.593562:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614117248 00000100:00100000:0.0:1788201210.593567:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614117248 00000100:00100000:0.0:1788201210.593605:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 208 00000100:00100000:0.0:1788201210.593613:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+55:11600:x1875064614117248:12345-192.168.203.14@tcp:36:bash.0 00010000:00010000:0.0:1788201210.593669:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201210.593684:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b787918 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d306b expref: 55 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.593698:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201210.593702:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201210.593900:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787942 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.593914:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787942 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.593924:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787942 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788201210.593990:0:5829:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1788201210.594030:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058be53b3 reply state 00000000f6b17fbf transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787942 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201210.594038:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201210.594117:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+57:11600:x1875064614117248:12345-192.168.203.14@tcp:36:bash.0 Request processed in 504us (684us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788201210.594160:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 208 00000020:00080000:0.0:1788201210.594165:0:5829:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788201210.599359:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787942 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.599375:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787942 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.599383:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787942 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.599389:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201210.599394:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787942 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.599401:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787942 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.599416:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201210.599419:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201210.599423:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787942 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.599430:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787942 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201210.608184:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201210.608265:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614117376 00000100:00100000:1.0:1788201210.608275:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614117376 00000100:00100000:1.0:1788201210.608324:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 209 00000100:00100000:1.0:1788201210.608335:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+56:11600:x1875064614117376:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788201210.608358:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201210.608379:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787949 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3079 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.608479:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787950 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.608511:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787950 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.608522:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787950 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201210.608555:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788201210.608559:0:5828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201210.608576:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787950 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.608601:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787949 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3079 expref: 58 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.608617:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787950 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3079 expref: 57 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.608626:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:1.0:1788201210.608629:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201210.608632:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680600, rc 0) 00000100:00100000:1.0:1788201210.608705:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+57:11600:x1875064614117376:12345-192.168.203.14@tcp:101:bash.0 Request processed in 372us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201210.608712:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 209 00000100:00100000:3.0:1788201210.614908:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201210.614999:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614117632 00000100:00100000:0.0:1788201210.615010:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614117632 00000100:00100000:0.0:1788201210.615076:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:0.0:1788201210.615087:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+57:11600:x1875064614117632:12345-192.168.203.14@tcp:35:bash.0 00000100:00100000:0.0:1788201210.615345:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+58:11600:x1875064614117632:12345-192.168.203.14@tcp:35:bash.0 Request processed in 259us (444us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788201210.615352:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:1.0:1788201210.635468:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b001f914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622489728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201210.635532:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201210.636047:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b001f914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622489856:0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.636083:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201210.636107:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b001f915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622490368:0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.636163:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201210.636188:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201210.636194:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b001f917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622489984:0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.636216:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201210.636246:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b001f915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622490240:0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.636269:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201210.636287:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201210.636292:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b001f914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622490112:0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.636314:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201210.636342:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622489856 00000100:00100000:2.0:1788201210.636349:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622489856 00000100:00100000:2.0:1788201210.636395:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788201210.636404:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0005022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622489856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.636455:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0005022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622489856:12345-0@lo:400:kworker.0 Request processed in 51us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201210.636461:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788201210.636505:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622490240 00000100:00100000:2.0:1788201210.636509:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622490240 00000100:00100000:2.0:1788201210.636541:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788201210.636547:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3295:x1875064622490240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.636584:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3295:x1875064622490240:12345-0@lo:400:kworker.0 Request processed in 37us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201210.636590:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788201210.636607:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622490368 00000100:00100000:2.0:1788201210.636610:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622490368 00000100:00100000:2.0:1788201210.636631:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622489984 00000100:00100000:2.0:1788201210.636633:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622489984 00000100:00100000:2.0:1788201210.636645:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622490112 00000100:00100000:2.0:1788201210.636656:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622490112 00000100:00100000:2.0:1788201210.636673:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788201210.636679:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622490368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.636708:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622490368:12345-0@lo:400:kworker.0 Request processed in 30us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201210.636715:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788201210.636727:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788201210.636732:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622489984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.636758:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622489984:12345-0@lo:400:kworker.0 Request processed in 26us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201210.636764:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788201210.636775:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788201210.636780:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622490112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.636806:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622490112:12345-0@lo:400:kworker.0 Request processed in 26us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201210.636820:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788201210.636858:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b001f914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622490112:0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.636870:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b001f915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622490240:0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.636896:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b001f917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622489984:0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.636903:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b001f914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622489856:0@lo:400:kworker.0 00000100:00100000:2.0:1788201210.636910:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b001f915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622490368:0@lo:400:kworker.0 00000100:00100000:3.0:1788201210.637329:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622489728 00000100:00100000:3.0:1788201210.637334:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622489728 00000100:00100000:3.0:1788201210.637371:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788201210.637379:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1875064622489728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201210.637394:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201210.637459:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1875064622489728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (1927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201210.637465:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788201210.637504:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b001f914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622489728:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788201210.637955:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201210.637960:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201210.666536:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201210.666706:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614117760 00000100:00100000:1.0:1788201210.666715:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614117760 00000100:00100000:1.0:1788201210.666773:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 210 00000100:00100000:1.0:1788201210.666798:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+58:11606:x1875064614117760:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788201210.666824:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201210.666845:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787957 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3080 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.666914:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b78795e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.666928:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b78795e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.666950:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b78795e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201210.667025:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1788201210.667030:0:5828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201210.667055:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b78795e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.667086:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787957 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3080 expref: 60 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.667102:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b78795e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3080 expref: 59 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.667110:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:1.0:1788201210.667113:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201210.667116:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681800, rc 0) 00000100:00100000:1.0:1788201210.667237:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+59:11606:x1875064614117760:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 441us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201210.667254:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 210 00000100:00100000:2.0:1788201210.676044:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201210.676930:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614117888 00000100:00100000:3.0:1788201210.676941:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614117888 00000100:00100000:3.0:1788201210.677007:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 211 00000100:00100000:3.0:1788201210.677018:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+59:11606:x1875064614117888:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788201210.677039:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201210.677060:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787965 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3087 expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677127:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b78796c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677182:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b78796c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677194:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b78796c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677212:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787973 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677219:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677227:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677340:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78797a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677349:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78797a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677356:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78797a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201210.677390:0:9471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788201210.677394:0:9471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201210.677411:0:9471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78797a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677422:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78797a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677430:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b78796c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677437:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b78796c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677443:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b78796c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677450:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201210.677454:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b78796c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677462:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b78796c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677485:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:3.0:1788201210.677488:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201210.677493:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b78796c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677500:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b78796c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677514:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677521:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787973 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677527:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787973 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677532:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201210.677534:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787973 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677540:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787973 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677547:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b00109a1900) 00010000:00010000:3.0:1788201210.677549:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201210.677552:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787973 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677558:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787973 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677601:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787965 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3087 expref: 61 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677621:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78797a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3087 expref: 60 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201210.677628:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:3.0:1788201210.677630:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201210.677633:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000030e00, rc 0) 00000100:00100000:3.0:1788201210.677718:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+60:11606:x1875064614117888:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 701us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201210.677726:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 211 00000100:00100000:3.0:1788201210.691246:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201210.691303:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201210.691356:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614118272 00000100:00100000:1.0:1788201210.691366:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614118272 00000100:00100000:1.0:1788201210.691428:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 212 00000100:00100000:1.0:1788201210.691436:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+60:11606:x1875064614118272:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788201210.691453:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201210.691473:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787981 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d308e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.691571:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.691587:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787950 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3079 expref: 61 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201210.691590:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614118016 00000100:00100000:2.0:1788201210.691595:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614118016 00010000:00010000:1.0:1788201210.691595:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78797a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3087 expref: 61 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.691603:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201210.691614:0:6691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78797a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3087 expref: 62 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.691635:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78797a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3087 expref: 62 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.691656:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78797a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3087 expref: 62 pid: 9471 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201210.691658:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 79 00000100:00100000:2.0:1788201210.691666:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+62:2349:x1875064614118016:12345-192.168.203.14@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201210.691668:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5828:1875064622490496:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788201210.691674:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201210.691681:0:6691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78797a lrc: 6/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3087 expref: 62 pid: 9471 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201210.691692:0:6691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78797a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3087 expref: 62 pid: 9471 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201210.691709:0:6691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:2.0:1788201210.691714:0:6691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201210.692371:0:6691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201210.692377:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201210.692426:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+62:2349:x1875064614118016:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 759us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201210.692434:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 79 00010000:00010000:1.0:1788201210.694792:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787950 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3079 expref: 61 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.694816:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787950 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3079 expref: 61 pid: 5828 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201210.694834:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5828:1875064622490624:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201210.694924:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6bc00 going to sleep for 11 seconds 00010000:00010000:1.0:1788201210.695774:0:5828:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.14@tcp) returned -22 from blocking AST (req@00000000c59b0447 x1875064622490496) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78797a lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3087 expref: 61 pid: 9471 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.695798:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030e00/0x72011f792b78797a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3087 expref: 61 pid: 9471 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201210.695816:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5828:1875064622490496:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201210.704583:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201210.704640:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5828:1875064622490624:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201210.704676:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:1.0:1788201210.704684:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.704694:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.704703:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201210.705528:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614118400 00000100:00100000:2.0:1788201210.705538:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614118400 00010000:00010000:2.0:1788201210.705572:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787950 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3079 expref: 61 pid: 5828 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201210.705614:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 80 00000100:00100000:2.0:1788201210.705623:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000679a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+61:2348:x1875064614118400:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201210.705639:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201210.705655:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787950 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3079 expref: 61 pid: 5828 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201210.705666:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787950 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3079 expref: 61 pid: 5828 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201210.705687:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680600/0x72011f792b787950 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3079 expref: 61 pid: 5828 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201210.705703:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:2.0:1788201210.705707:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201210.705730:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201210.705752:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201210.705779:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201210.705834:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000679a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+60:2348:x1875064614118400:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 211us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201210.705841:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 80 00010000:00010000:1.0:1788201210.706106:0:5828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.706150:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201210.706171:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788201210.706326:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681e00/0x72011f792b787981 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d308e expref: 61 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.706342:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d308e expref: 60 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201210.706350:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:1.0:1788201210.706353:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788201210.706355:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680000, rc 0) 00000100:00100000:1.0:1788201210.706394:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+60:11606:x1875064614118272:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 14958us (15091us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1788201210.706401:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 212 00000100:00100000:3.0:1788201210.721235:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201210.722193:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614118656 00000100:00100000:0.0:1788201210.722204:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614118656 00000100:00100000:0.0:1788201210.722276:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:0.0:1788201210.722287:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+60:11606:x1875064614118656:12345-192.168.203.14@tcp:103:lfs.0 00010000:00010000:0.0:1788201210.722314:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201210.722338:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b7878e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3064 expref: 60 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.722357:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201210.722361:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201210.722422:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+59:11606:x1875064614118656:12345-192.168.203.14@tcp:103:lfs.0 Request processed in 136us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201210.722429:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:3.0:1788201210.724442:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201210.727439:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614118784 00000100:00100000:0.0:1788201210.727453:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614118784 00000100:00100000:0.0:1788201210.727522:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 213 00000100:00100000:0.0:1788201210.727533:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+59:11606:x1875064614118784:12345-192.168.203.14@tcp:58:lfs.0 00010000:00010000:0.0:1788201210.727659:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787996 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.727677:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787996 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.727688:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787996 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201210.727869:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788201210.727963:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+59:11606:x1875064614118784:12345-192.168.203.14@tcp:58:lfs.0 Request processed in 431us (3527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201210.727970:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 213 00000100:00100000:3.0:1788201210.732964:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201210.733021:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614118912 00000100:00100000:0.0:1788201210.733030:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614118912 00000100:00100000:0.0:1788201210.733099:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 214 00000100:00100000:0.0:1788201210.733109:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+59:11606:x1875064614118912:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788201210.733166:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201210.733186:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78799d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3095 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.733243:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787996 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.733253:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78799d lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3095 expref: 60 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.733269:0:5829:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787996 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.733298:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78799d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3095 expref: 60 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.733311:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201210.733314:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201210.733317:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78799d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3095 expref: 60 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201210.733324:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676fc00, rc 0) 00000100:00100000:0.0:1788201210.733383:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+60:11606:x1875064614118912:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 276us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201210.733390:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 214 00000040:00080000:2.0:1788201211.339437:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788201211.339446:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201211.339484:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788201211.339490:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788201211.339621:0:11684:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b001f916a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875064622490752:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788201211.339732:0:11684:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8e43c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788201211.341591:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201211.354936:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201211.355089:0:11684:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b001f916a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875064622490752:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788201211.355439:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614119040 00000100:00100000:0.0:1788201211.355447:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614119040 00000100:00100000:0.0:1788201211.355520:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 215 00000100:00100000:0.0:1788201211.355531:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+60:11607:x1875064614119040:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788201211.355565:0:5827:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788201211.355682:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+60:11607:x1875064614119040:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 152us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.355690:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 215 00000100:00080000:2.0:1788201211.357628:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201211.372756:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201211.372962:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614119168 00000100:00100000:0.0:1788201211.372972:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614119168 00000100:00100000:0.0:1788201211.373029:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 216 00000100:00100000:0.0:1788201211.373038:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+60:11607:x1875064614119168:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788201211.373172:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b7879a4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.373207:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b7879a4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.373219:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b7879a4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.373238:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7879ab lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.373245:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7879ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.373264:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7879ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.373289:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.373297:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.373303:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201211.373341:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788201211.373345:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201211.373359:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.373369:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b7879a4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.373386:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b7879a4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.373392:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b7879a4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.373397:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676fa00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201211.373401:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b7879a4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.373407:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b7879a4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.373419:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b0011cb3e00) 00010000:00010000:0.0:1788201211.373422:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201211.373426:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b7879a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.373432:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b7879a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.373446:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7879ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.373451:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7879ab lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.373457:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7879ab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.374184:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201211.374199:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7879ab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.374207:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7879ab lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.374218:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9b0002a80d00) 00010000:00010000:0.0:1788201211.374222:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201211.374225:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7879ab lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.374231:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7879ab lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.374674:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.374682:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.374688:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.374693:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201211.374696:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.374701:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.374710:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201211.374712:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201211.374723:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.374728:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201211.374827:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+60:11607:x1875064614119168:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 Request processed in 1786us (2078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.374837:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 216 00000100:00100000:1.0:1788201211.381617:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201211.381762:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614119424 00000100:00100000:0.0:1788201211.381777:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614119424 00000100:00100000:0.0:1788201211.381909:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 217 00000100:00100000:0.0:1788201211.381923:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+60:11607:x1875064614119424:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201211.381951:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201211.381979:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b7879b9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d309c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.382185:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b7879c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.382205:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b7879c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.382220:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b7879c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201211.382238:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788201211.382469:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b7879c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.382479:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b7879c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.382486:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b7879c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.382493:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676e200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201211.382523:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b7879c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.382532:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b7879c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.382549:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:1.0:1788201211.382552:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788201211.382558:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b7879c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.382566:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b7879c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.382623:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b7879b9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d309c expref: 62 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.382634:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b0011cb3e00) 00010000:00010000:1.0:1788201211.382637:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201211.382651:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fa00/0x72011f792b7879b9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d309c expref: 62 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.382664:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676fa00, rc 0) 00000100:00100000:1.0:1788201211.382901:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+61:11607:x1875064614119424:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 980us (1300us total) trans 4294967504 rc 301/301 00000100:00100000:1.0:1788201211.382911:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 217 00000100:00100000:3.0:1788201211.397700:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201211.398165:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614119552 00000100:00100000:1.0:1788201211.398180:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614119552 00000100:00100000:1.0:1788201211.398275:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 218 00000100:00100000:1.0:1788201211.398288:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+61:11607:x1875064614119552:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788201211.398385:0:5828:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788201211.398631:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+61:11607:x1875064614119552:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 344us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201211.398650:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 218 00000100:00100000:3.0:1788201211.400790:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201211.401033:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614119808 00000100:00100000:0.0:1788201211.401046:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614119808 00000100:00100000:0.0:1788201211.401125:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 219 00000100:00100000:0.0:1788201211.401184:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+61:11607:x1875064614119808:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201211.401237:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201211.401241:0:9471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788201211.401283:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b78795e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3080 expref: 61 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.401309:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:0.0:1788201211.401314:0:9471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201211.401333:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d30a3 expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201211.401934:0:9471:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1788201211.402219:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7879d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.402237:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7879d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.402249:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7879d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.402319:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30a3 expref: 63 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.402342:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7879d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30a3 expref: 62 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.402352:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b0002a80d00) 00010000:00010000:0.0:1788201211.402356:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201211.402374:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676f800, rc 0) 00000100:00100000:0.0:1788201211.402473:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+62:11607:x1875064614119808:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 1336us (1697us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788201211.402483:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 219 00000100:00100000:3.0:1788201211.407817:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201211.407993:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614120064 00000100:00100000:1.0:1788201211.408006:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614120064 00000100:00100000:1.0:1788201211.408094:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 220 00000100:00100000:1.0:1788201211.408108:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+62:11607:x1875064614120064:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788201211.408328:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201211.408366:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7879d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30a3 expref: 62 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.408392:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b0002a80d00) 00010000:00010000:1.0:1788201211.408405:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201211.408435:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7879e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.408457:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7879e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.408470:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7879e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.408489:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7879ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x2ec251a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.408497:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7879ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2ec251a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.408531:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7879ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2ec251a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.408637:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7879e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.408656:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7879e3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.408664:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7879e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.408670:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201211.408676:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7879e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.408684:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7879e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.408693:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:1.0:1788201211.408696:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201211.408700:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7879e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.408708:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681800/0x72011f792b7879e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.409130:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7879ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2ec251a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.409237:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7879ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2ec251a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.409257:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7879ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2ec251a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.409263:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201211.409267:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7879ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2ec251a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.409275:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7879ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2ec251a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.409286:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x2ec251a9 (ffff9b00033b2c00) 00010000:00010000:1.0:1788201211.409288:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201211.409292:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7879ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2ec251a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.409299:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b7879ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2ec251a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201211.409464:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+61:11607:x1875064614120064:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 1357us (1664us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201211.409472:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 220 00000100:00100000:3.0:1788201211.411813:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201211.411880:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614120192 00000100:00100000:0.0:1788201211.411892:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614120192 00000100:00100000:0.0:1788201211.411997:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 221 00000100:00100000:0.0:1788201211.412020:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+61:11607:x1875064614120192:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201211.412055:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201211.412086:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b7879f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d30aa expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.412131:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7879f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.412228:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7879f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.412237:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7879f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.412350:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b7879f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30aa expref: 63 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.412377:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7879f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30aa expref: 62 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.412388:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:0.0:1788201211.412391:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788201211.412401:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676f000, rc 0) 00000100:00100000:0.0:1788201211.412585:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+62:11607:x1875064614120192:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 575us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.412593:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 221 00000100:00100000:3.0:1788201211.415269:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201211.415336:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614120448 00000100:00100000:0.0:1788201211.415354:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614120448 00000100:00100000:0.0:1788201211.415438:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 222 00000100:00100000:0.0:1788201211.415452:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+62:11607:x1875064614120448:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788201211.415799:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.415824:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.415841:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201211.417372:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1788201211.417394:0:5829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 290542259029ns, next at 291542254304ns, rc = 0 00000004:00010000:0.0:1788201211.417602:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b07cd426 reply state 00000000e69159c8 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201211.417615:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201211.417808:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+64:11607:x1875064614120448:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 2354us (2959us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788201211.417819:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 222 00010000:00010000:0.0:1788201211.421069:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.421094:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201211.421202:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00010000:00010000:0.0:1788201211.421206:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.421216:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201211.421223:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.421232:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.421255:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b0002a80000) 00000100:00100000:1.0:1788201211.421257:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614120576 00010000:00010000:0.0:1788201211.421260:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201211.421266:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201211.421273:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614120576 00010000:00010000:0.0:1788201211.421274:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b7879ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201211.421349:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 223 00000100:00100000:1.0:1788201211.421360:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+63:11607:x1875064614120576:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201211.421408:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201211.421437:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787a06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d30b1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.421536:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787a06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30b1 expref: 64 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.421554:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787a06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30b1 expref: 64 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.421582:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:1.0:1788201211.421585:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201211.421587:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680e00, rc 0) 00000100:00100000:1.0:1788201211.421683:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+64:11607:x1875064614120576:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 324us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201211.421691:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 223 00000100:00100000:3.0:1788201211.427113:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201211.427218:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614120704 00000100:00100000:0.0:1788201211.427232:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614120704 00000100:00100000:1.0:1788201211.427371:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 62 00000100:00100000:1.0:1788201211.427383:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:2349:x1875064614120704:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788201211.427765:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201211.428076:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+10:2349:x1875064614120704:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 685us (963us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788201211.428088:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 62 00000100:00100000:3.0:1788201211.438271:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201211.438966:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614120960 00000100:00100000:0.0:1788201211.438981:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614120960 00000100:00100000:0.0:1788201211.441253:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:0.0:1788201211.441298:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+64:11607:x1875064614120960:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788201211.441656:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+65:11607:x1875064614120960:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 387us (3399us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788201211.441899:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:2.0:1788201211.452921:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201211.453038:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614121216 00000100:00100000:3.0:1788201211.453051:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614121216 00000100:00100000:3.0:1788201211.453125:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 224 00000100:00100000:3.0:1788201211.453180:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+65:11607:x1875064614121216:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788201211.453337:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+65:11607:x1875064614121216:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 201us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201211.453347:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 224 00000100:00100000:3.0:1788201211.463316:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201211.463379:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614121344 00000100:00100000:0.0:1788201211.463393:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614121344 00000100:00100000:0.0:1788201211.463495:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 225 00000100:00100000:0.0:1788201211.463508:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+65:11607:x1875064614121344:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201211.463539:0:9471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201211.463567:0:9471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787a0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d30b8 expref: -99 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.463700:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b787a14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.463718:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b787a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.463743:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b787a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201211.463798:0:9471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201211.463823:0:9471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b787a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.463854:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f600/0x72011f792b787a0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30b8 expref: 67 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.463876:0:9471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b787a14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30b8 expref: 66 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.463886:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:0.0:1788201211.463889:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788201211.463894:0:9471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676ee00, rc 0) 00000100:00100000:0.0:1788201211.463973:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+66:11607:x1875064614121344:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 468us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.463989:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 225 00000100:00100000:2.0:1788201211.470657:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201211.470787:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614121472 00000100:00100000:1.0:1788201211.470800:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614121472 00000100:00100000:1.0:1788201211.470897:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 63 00000100:00100000:1.0:1788201211.470910:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+10:2349:x1875064614121472:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201211.470935:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201211.470963:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787a1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d30bf expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201211.471020:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95c8fb, blocks: 0x1 00010000:00010000:1.0:1788201211.471046:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=290s v=(0 0) 00010000:00010000:1.0:1788201211.471051:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201211.471064:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787a1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30bf expref: 11 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.471085:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787a1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30bf expref: 11 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201211.471101:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681800, rc 0) 00000100:00100000:1.0:1788201211.471203:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+11:2349:x1875064614121472:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 294us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201211.471210:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 63 00000100:00100000:2.0:1788201211.473346:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201211.473840:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614121728 00000100:00100000:0.0:1788201211.473853:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614121728 00000100:00100000:0.0:1788201211.473979:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 226 00000100:00100000:0.0:1788201211.473993:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+66:11607:x1875064614121728:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788201211.474173:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+66:11607:x1875064614121728:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 183us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.474183:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 226 00000100:00100000:3.0:1788201211.483783:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201211.484329:0:12066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614121856 00000100:00100000:0.0:1788201211.484341:0:12066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614121856 00000100:00100000:0.0:1788201211.484437:0:12066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 64 00000100:00100000:0.0:1788201211.484449:0:12066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+11:11607:x1875064614121856:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201211.484473:0:12066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201211.484497:0:12066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787a22 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d30c6 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.484549:0:12066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787a1b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30bf expref: 12 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.484559:0:12066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201211.484564:0:12066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201211.484570:0:12066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787a22 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30c6 expref: 12 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.484620:0:12066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787a1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30bf expref: 12 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.484731:0:12066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787a1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30bf expref: 12 pid: 6677 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201211.484750:0:12066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12066:1875064622490880:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788201211.484889:0:12066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003b3ba0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201211.488613:0:12066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12066:1875064622490880:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788201211.488680:0:12066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787a22 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30c6 expref: 12 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.488711:0:12066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676f600, rc 0) 00000100:00100000:0.0:1788201211.488797:0:12066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+12:11607:x1875064614121856:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 4350us (5027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.488809:0:12066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 64 00000100:00100000:2.0:1788201211.492598:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201211.492705:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614121984 00000100:00100000:3.0:1788201211.492718:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614121984 00010000:00010000:3.0:1788201211.492773:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787a1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30bf expref: 12 pid: 6677 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201211.492877:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 81 00000100:00100000:3.0:1788201211.492890:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f914000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+12:2348:x1875064614121984:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201211.492911:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201211.492940:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787a1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30bf expref: 12 pid: 6677 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.492957:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787a1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30bf expref: 12 pid: 6677 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.492985:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787a1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30bf expref: 12 pid: 6677 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.493034:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201211.493040:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201211.493051:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787a22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30c6 expref: 11 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.493064:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787a22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30c6 expref: 11 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.493247:0:5813:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787a22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30c6 expref: 11 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201211.493267:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f435180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5813:1875064622491008:192.168.203.14@tcp:105: 00000100:00100000:3.0:1788201211.493559:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0007ebaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201211.499730:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f435180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5813:1875064622491008:192.168.203.14@tcp:105: 00010000:00010000:2.0:1788201211.499772:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201211.499852:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f914000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+11:2348:x1875064614121984:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 6963us (7268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201211.499888:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 81 00000100:00100000:3.0:1788201211.505104:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201211.505532:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614122112 00000100:00100000:2.0:1788201211.505550:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614122112 00002000:00100000:2.0:1788201211.505635:0:6682:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9b003f435f80 x1875064614122112/t0(0) o4->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:332/0 lens 504/0 e 0 to 0 dl 1788201222 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201211.505679:0:6682:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b003f435f80 with x1875064614122112 ext(0->12) 00002000:00010000:2.0:1788201211.505686:0:6682:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b003f435f80 00000100:00100000:2.0:1788201211.505733:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:2.0:1788201211.505743:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+11:2349:x1875064614122112:12345-192.168.203.14@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788201211.506703:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+13:2349:x1875064614122112:12345-192.168.203.14@tcp:4:lhsmtool_posix.0 Request processed in 954us (1603us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788201211.506714:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00002000:00100000:2.0:1788201211.506723:0:6682:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9b003f435f80 x1875064614122112/t4294967320(0) o4->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:332/0 lens 504/448 e 0 to 0 dl 1788201222 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201211.506732:0:6682:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b003f435f80 with x1875064614122112 ext(0->12) 00002000:00010000:2.0:1788201211.506739:0:6682:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b003f435f80 00000100:00100000:3.0:1788201211.512510:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201211.512777:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614122240 00000100:00100000:1.0:1788201211.512798:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614122240 00000100:00100000:1.0:1788201211.512871:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 227 00000100:00100000:1.0:1788201211.512882:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+66:11607:x1875064614122240:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788201211.551884:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:2.0:1788201211.551903:0:5849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1788201211.551933:0:5849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788201211.551952:0:5849:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b003b3ba480 refcount 2 committed 0 result 0 batchid 7 00000100:00100000:3.0:1788201211.552225:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622491136:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201211.552286:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201211.552358:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622491264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788201211.552380:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201211.552411:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622491136 00000100:00100000:3.0:1788201211.552418:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622491136 00000100:00100000:3.0:1788201211.552454:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622491264 00000100:00100000:3.0:1788201211.552456:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622491264 00000100:00100000:3.0:1788201211.552474:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788201211.552481:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3293:x1875064622491136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201211.552518:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1788201211.552542:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0f93dba/0x72011f792b787a29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.552563:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065bd2276/0x72011f792b7877eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3025 expref: 12 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.552572:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788201211.552576:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201211.552585:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0f93dba/0x72011f792b787a29 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.552609:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065bd2276/0x72011f792b7877eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3025 expref: 12 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.552622:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065bd2276/0x72011f792b7877eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3025 expref: 12 pid: 7765 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201211.552632:0:6678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f434380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6678:1875064622491392:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201211.552695:0:6678:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0007eba180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201211.552710:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788201211.552717:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3294:x1875064622491264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788201211.552985:0:6675:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788201211.552990:0:6675:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788201211 00002000:00010000:3.0:1788201211.552992:0:6675:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788201211.552993:0:6675:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788201211 -> 1788201211 00002000:00010000:3.0:1788201211.553002:0:6675:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788201211.553117:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3294:x1875064622491264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 400us (735us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788201211.553125:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000020:00080000:2.0:1788201211.553850:0:5849:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b0035db6a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b003b3ba000 00000020:00080000:2.0:1788201211.553855:0:5849:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b0035db6c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b0003eb2400 00000004:00080000:2.0:1788201211.554771:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b003f437100/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788201211.555108:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+45:11607:x1875064614122240:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 Request processed in 42223us (42604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.555119:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 227 00000100:00100000:2.0:1788201211.555256:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622491264:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788201211.555268:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201211.555277:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622491520:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1788201211.555305:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788201211.555337:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201211.555415:0:12066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622491520 00000100:00100000:0.0:1788201211.555423:0:12066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622491520 00000020:00080000:3.0:1788201211.555435:0:5849:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b000a759540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788201211.555441:0:5849:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b0011f35500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b000a7599c0 00000020:00080000:3.0:1788201211.555444:0:5849:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b0011f35d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b0040407800 00000100:00100000:0.0:1788201211.555482:0:12066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000020:00080000:1.0:1788201211.555484:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:0.0:1788201211.555493:0:12066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3294:x1875064622491520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201211.555522:0:12066:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1788201211.555557:0:12066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a95c8f9, atime: 0x6a95c8fa, ctime: 0x6a95c8f9, blocks: 0x1 00010000:00010000:0.0:1788201211.555565:0:12066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e59672f5/0x72011f792b787a30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.555588:0:12066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=290s v=(0 0) 00010000:00010000:0.0:1788201211.555593:0:12066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201211.555600:0:12066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e59672f5/0x72011f792b787a30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788201211.555690:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:3.0:1788201211.555784:0:5849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00010000:00010000:0.0:1788201211.555844:0:12066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e59672f5/0x72011f792b787a30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.555857:0:12066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e59672f5/0x72011f792b787a30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.555865:0:12066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e59672f5/0x72011f792b787a30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.555891:0:12066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201211.555922:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201211.555928:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e59672f5/0x72011f792b787a30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201211.555936:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676e400 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:2.0:1788201211.555939:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e59672f5/0x72011f792b787a30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201211.555946:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e59672f5/0x72011f792b787a30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201211.555968:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e59672f5/0x72011f792b787a30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201211.555973:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e59672f5/0x72011f792b787a30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201211.555988:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201211.555989:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201211.555990:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201211.556422:0:12066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3294:x1875064622491520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 930us (1084us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788201211.556439:0:12066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:3.0:1788201211.556460:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b003b0ac700/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788201211.556465:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622491520:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201211.558928:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201211.558969:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201211.559040:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614122496 00000100:00100000:2.0:1788201211.559050:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614122496 00000100:00100000:1.0:1788201211.559056:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614122368 00000100:00100000:1.0:1788201211.559059:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614122368 00010000:00010000:2.0:1788201211.559088:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065bd2276/0x72011f792b7877eb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3025 expref: 14 pid: 7765 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201211.559121:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 82 00000100:00100000:2.0:1788201211.559131:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:2348:x1875064614122496:12345-192.168.203.14@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201211.559155:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 68 00010000:00010000:2.0:1788201211.559162:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788201211.559162:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:2348:x1875064614122368:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788201211.559167:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065bd2276/0x72011f792b7877eb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3025 expref: 14 pid: 7765 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201211.559180:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065bd2276/0x72011f792b7877eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3025 expref: 14 pid: 7765 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201211.559204:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201211.559208:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201211.559214:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0f93dba/0x72011f792b787a29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201211.559224:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0f93dba/0x72011f792b787a29 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201211.559245:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201211.559297:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+14:2348:x1875064614122496:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 167us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201211.559305:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 82 00010000:00010000:3.0:1788201211.560412:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065bd2276/0x72011f792b7877eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3025 expref: 13 pid: 7765 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201211.560556:0:6678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f434380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6678:1875064622491392:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788201211.560578:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b0f93dba/0x72011f792b787a29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.560588:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b0f93dba/0x72011f792b787a29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.560594:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0f93dba/0x72011f792b787a29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.560604:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0f93dba/0x72011f792b787a29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.560625:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0f93dba/0x72011f792b787a29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.560661:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201211.561409:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201211.561417:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0f93dba/0x72011f792b787a29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.561425:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030a00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201211.561482:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0f93dba/0x72011f792b787a29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.561490:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0f93dba/0x72011f792b787a29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.561517:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0f93dba/0x72011f792b787a29 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.561522:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0f93dba/0x72011f792b787a29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.561540:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201211.561542:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201211.561543:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201211.562426:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3293:x1875064622491136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9938us (10133us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788201211.562438:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:0.0:1788201211.562983:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b003f435500/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788201211.562992:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622491136:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1788201211.595413:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:1.0:1788201211.595441:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1788201211.595448:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:1.0:1788201211.595457:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1788201211.595512:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2348:x1875064614122368:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 Request processed in 36344us (36588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.595528:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 68 00000100:00100000:0.0:1788201211.597858:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201211.597944:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614122752 00000100:00100000:3.0:1788201211.597953:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614122752 00000100:00100000:3.0:1788201211.598073:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 228 00000100:00100000:3.0:1788201211.598085:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:11607:x1875064614122752:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788201211.598696:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201211.598736:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b787a14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30b8 expref: 20 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.598759:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:3.0:1788201211.598764:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201211.598808:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.598823:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.598832:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201211.599083:0:5828:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d50fd9e4 reply state 000000007d8b1584 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201211.599105:0:5828:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201211.599245:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:11607:x1875064614122752:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 1161us (1395us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1788201211.599252:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 228 00010000:00010000:0.0:1788201211.603407:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.603427:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.603435:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.603442:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201211.603447:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.603471:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.603493:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:0.0:1788201211.603496:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201211.603501:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.603517:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201211.603631:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201211.604034:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614122880 00000100:00100000:2.0:1788201211.604051:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614122880 00000100:00100000:2.0:1788201211.604093:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:2.0:1788201211.604101:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2348:x1875064614122880:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788201211.604359:0:6675:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788201211.604362:0:6675:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788201211 -> 1788201210 00002000:00010000:2.0:1788201211.604364:0:6675:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788201210 00002000:00010000:2.0:1788201211.604365:0:6675:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788201211 -> 1788201210 00002000:00010000:2.0:1788201211.604367:0:6675:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788201211.604418:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2348:x1875064614122880:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 318us (792us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788201211.604423:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:1.0:1788201211.608449:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201211.608851:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614123136 00000100:00100000:3.0:1788201211.608861:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614123136 00000100:00100000:3.0:1788201211.608922:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 229 00000100:00100000:3.0:1788201211.608933:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:11607:x1875064614123136:12345-192.168.203.14@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788201211.609012:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.609032:0:9471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7879f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30aa expref: 20 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.609043:0:9471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a3e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.609079:0:9471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7879f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30aa expref: 20 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.609092:0:9471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7879f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30aa expref: 20 pid: 9471 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201211.609107:0:9471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f434380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9471:1875064622491648:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201211.609247:0:9471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0007eba180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201211.616804:0:9471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f434380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9471:1875064622491648:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788201211.616863:0:9471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201211.617413:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201211.617470:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614123264 00000100:00100000:0.0:1788201211.617478:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614123264 00010000:00010000:0.0:1788201211.617517:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7879f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30aa expref: 21 pid: 9471 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201211.617557:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 83 00000100:00100000:0.0:1788201211.617567:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:2349:x1875064614123264:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201211.617586:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201211.617594:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7879f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30aa expref: 21 pid: 9471 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.617607:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7879f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30aa expref: 21 pid: 9471 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.617630:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b7879f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30aa expref: 21 pid: 9471 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.617669:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:0.0:1788201211.617674:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.617683:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.617690:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a3e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.617713:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201211.617880:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:2349:x1875064614123264:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 314us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.617888:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 83 00010000:00010000:3.0:1788201211.618115:0:9471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.618407:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.618448:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.618456:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.618463:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.618469:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201211.618473:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.618480:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.618492:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:3.0:1788201211.618495:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788201211.618500:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a3e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.618507:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201211.618620:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:11607:x1875064614123136:12345-192.168.203.14@tcp:55:lhsmtool_posix.0 Request processed in 9688us (10180us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788201211.618628:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 229 00000100:00100000:1.0:1788201211.621416:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201211.621551:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614123392 00000100:00100000:0.0:1788201211.621561:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614123392 00000100:00100000:0.0:1788201211.621617:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 70 00000100:00100000:0.0:1788201211.621627:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2351:x1875064614123392:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788201211.621691:0:7765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787a45 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.621714:0:7765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787a22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30c6 expref: 8 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.621723:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201211.621727:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788201211.621731:0:7765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787a45 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.621800:0:7765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787a22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30c6 expref: 8 pid: 12066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.621815:0:7765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787a22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30c6 expref: 8 pid: 12066 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201211.621830:0:7765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f378e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7765:1875064622491776:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788201211.621911:0:7765:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000a759a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201211.627454:0:7765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f378e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7765:1875064622491776:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788201211.627486:0:7765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787a45 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201211.629735:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201211.629806:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614123520 00000100:00100000:2.0:1788201211.629816:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614123520 00010000:00010000:2.0:1788201211.629872:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787a22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30c6 expref: 9 pid: 12066 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201211.629926:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 84 00000100:00100000:2.0:1788201211.629941:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+9:2348:x1875064614123520:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201211.629956:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201211.629980:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787a22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30c6 expref: 9 pid: 12066 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201211.629994:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787a22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30c6 expref: 9 pid: 12066 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201211.630016:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787a22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30c6 expref: 9 pid: 12066 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201211.630046:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201211.630051:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201211.630056:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787a45 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201211.630066:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787a45 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201211.630099:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201211.630195:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2348:x1875064614123520:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 260us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201211.630211:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 84 00010000:00010000:0.0:1788201211.630399:0:7765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787a45 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.630410:0:7765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787a45 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.630434:0:7765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787a45 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.630442:0:7765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787a45 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.630460:0:7765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787a45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.630468:0:7765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676ee00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201211.630472:0:7765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787a45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.630481:0:7765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787a45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.630492:0:7765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787a45 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.630499:0:7765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787a45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201211.630546:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2351:x1875064614123392:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 Request processed in 8921us (9141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.630554:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 70 00000100:00100000:2.0:1788201211.636872:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201211.638830:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614123776 00000100:00100000:0.0:1788201211.638853:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614123776 00000100:00100000:0.0:1788201211.638928:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 230 00000100:00100000:0.0:1788201211.638940:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:11607:x1875064614123776:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788201211.639024:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b787a4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.639057:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b787a4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.639070:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b787a4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.639349:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787a53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.639361:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787a06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30b1 expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.639369:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787a53 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.639403:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787a06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30b1 expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.639415:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787a06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30b1 expref: 20 pid: 5827 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201211.639428:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f378e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5829:1875064622491904:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788201211.639503:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000a759a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201211.643990:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201211.644068:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f378e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5829:1875064622491904:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788201211.644100:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787a53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201211.644345:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614123904 00000100:00100000:2.0:1788201211.644353:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614123904 00010000:00010000:2.0:1788201211.644391:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787a06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30b1 expref: 21 pid: 5827 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201211.644593:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 85 00000100:00100000:0.0:1788201211.644619:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f434380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:2349:x1875064614123904:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201211.644634:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201211.644651:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787a06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30b1 expref: 21 pid: 5827 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.644664:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787a06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30b1 expref: 21 pid: 5827 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.644685:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680e00/0x72011f792b787a06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30b1 expref: 21 pid: 5827 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.644702:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:0.0:1788201211.644708:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787a53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.644813:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787a53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.644822:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787a53 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.644891:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201211.644958:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f434380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:2349:x1875064614123904:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 340us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.644966:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 85 00010000:00010000:2.0:1788201211.646418:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787a53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201211.646443:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787a53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201211.646637:0:5829:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788201211.646788:0:5829:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1788201211.646833:0:5829:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788201211.646946:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b001f914380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5829:1875064622492032:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788201211.647075:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201211.647348:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003b3ba6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201211.647464:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622492032 00000100:00100000:1.0:1788201211.647471:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622492032 00000100:00100000:1.0:1788201211.647549:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201211.647558:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5829:x1875064622492032:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788201211.647649:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5829:x1875064622492032:12345-0@lo:1000:mdt00_002.0 Request processed in 83us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201211.647657:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201211.647711:0:5829:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1788201211.647717:0:5829:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1788201211.647735:0:5829:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b003f437100, transno 4294967321 00000100:00100000:0.0:1788201211.647757:0:5829:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b003f435500 x1875064622491136/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201227 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201211.647781:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b001f914380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5829:1875064622492032:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788201211.648289:0:5829:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1788201211.648350:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f378e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5829:1875064622492160:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201211.648388:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201211.651061:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622492160 00000100:00100000:2.0:1788201211.651075:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622492160 00000100:00100000:0.0:1788201211.651097:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000a759780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201211.651304:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201211.651317:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5829:x1875064622492160:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788201211.651751:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5829:x1875064622492160:12345-0@lo:1000:mdt00_002.0 Request processed in 437us (3361us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788201211.651757:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201211.651866:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f378e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5829:1875064622492160:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788201211.651908:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787a53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.651918:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787a53 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.651925:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787a53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.651931:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201211.651936:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787a53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.651942:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787a53 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.652021:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b0002a80000) 00010000:00010000:0.0:1788201211.652025:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201211.652029:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787a53 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.652035:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f000/0x72011f792b787a53 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.652085:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787996 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.652091:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787996 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.652097:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787996 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.652102:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201211.652105:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787996 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.652111:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787996 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.652120:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201211.652122:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201211.652129:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78799d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3095 expref: 23 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.652245:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78799d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3095 expref: 23 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.652254:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78799d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3095 expref: 23 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.652303:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78799d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3095 expref: 23 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201211.652327:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f84000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5829:1875064622492288:192.168.203.14@tcp:105: 00000100:00100000:0.0:1788201211.652401:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000a759780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201211.656990:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f84000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5829:1875064622492288:192.168.203.14@tcp:105: 00010000:00010000:0.0:1788201211.657024:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787996 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.657034:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f200/0x72011f792b787996 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.657075:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b787a5a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.657088:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b787a5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.657098:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b787a5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.657109:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b787a5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.657115:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b787a5a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.657121:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b787a5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.657127:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676ec00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201211.657130:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b787a5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.657195:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b787a5a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.657208:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201211.657211:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201211.657215:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b787a5a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.657220:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ec00/0x72011f792b787a5a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.657232:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b787a4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.657237:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b787a4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.657243:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b787a4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.657248:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676ee00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201211.657251:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b787a4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.657257:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b787a4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.657264:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201211.657267:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788201211.657269:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b787a4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.657286:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676ee00/0x72011f792b787a4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201211.657659:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+23:11607:x1875064614123776:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 18719us (20792us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1788201211.657671:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 230 00000020:00080000:0.0:1788201211.657678:0:5829:0:(tgt_main.c:807:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788201211.657836:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788201211.657841:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201211.658378:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788201211.658387:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788201211.661559:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201211.661742:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614124032 00000100:00100000:3.0:1788201211.661752:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614124032 00000100:00100000:3.0:1788201211.661821:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:3.0:1788201211.661831:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+23:11606:x1875064614124032:12345-192.168.203.14@tcp:49:lfs.0 00000100:00100000:2.0:1788201211.661949:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201211.661975:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+23:11606:x1875064614124032:12345-192.168.203.14@tcp:49:lfs.0 Request processed in 145us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201211.661983:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:3.0:1788201211.662000:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614124288 00000100:00100000:3.0:1788201211.662004:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614124288 00000100:00100000:3.0:1788201211.662033:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 62 00000100:00100000:3.0:1788201211.662042:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002289ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+23:11607:x1875064614124288:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788201211.662061:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622492416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201211.662104:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201211.662353:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622492416 00000100:00100000:1.0:1788201211.662358:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622492416 00000100:00100000:1.0:1788201211.662401:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788201211.662411:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1875064622492416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201211.662425:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788201211.662467:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1875064622492416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201211.662473:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788201211.662527:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622492416:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788201211.662738:0:5831:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788201211.662904:0:5831:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:3.0:1788201211.662965:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.662982:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.662993:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.663003:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a61 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.663018:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a61 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.663024:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.663043:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201211.665291:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002289ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+25:11607:x1875064614124288:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 3240us (3333us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788201211.665306:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 62 00000020:00080000:3.0:1788201211.665318:0:5831:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788201211.665382:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201211.665391:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.665401:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030800 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201211.665406:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.665416:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.665432:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b00109a1400) 00010000:00010000:3.0:1788201211.665437:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201211.665441:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a61 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.665448:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a61 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.665487:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201211.665488:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201211.665490:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201211.668774:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201211.668983:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614124544 00000100:00100000:0.0:1788201211.668995:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614124544 00000100:00100000:0.0:1788201211.669458:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 231 00000100:00100000:0.0:1788201211.669470:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+25:11606:x1875064614124544:12345-192.168.203.14@tcp:58:lfs.0 00000040:00080000:0.0:1788201211.669749:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788201211.669851:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+25:11606:x1875064614124544:12345-192.168.203.14@tcp:58:lfs.0 Request processed in 382us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.669864:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 231 00000100:00100000:2.0:1788201211.705413:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201211.706815:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614124672 00000100:00100000:3.0:1788201211.706830:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614124672 00000100:00100000:3.0:1788201211.707018:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 232 00000100:00100000:3.0:1788201211.707030:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+25:11609:x1875064614124672:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788201211.707052:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201211.707073:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d30cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.707175:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787a6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.707190:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787a6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.707202:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787a6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.707219:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.707226:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.707233:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.707562:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787a7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.707582:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d308e expref: 26 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.707590:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787a7d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.707621:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d308e expref: 26 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.707634:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d308e expref: 26 pid: 5828 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201211.707661:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f437b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5828:1875064622492544:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201211.707767:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0007ebaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201211.709957:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f437b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5828:1875064622492544:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788201211.709987:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787a7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201211.711942:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201211.712058:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614124928 00000100:00100000:0.0:1788201211.712067:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614124928 00000100:00100000:0.0:1788201211.712113:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 63 00000100:00100000:0.0:1788201211.712122:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:5586:x1875064614124928:12345-192.168.203.14@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788201211.712994:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:5586:x1875064614124928:12345-192.168.203.14@tcp:35:ldlm_bl.0 Request processed in 867us (1055us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788201211.713014:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 63 00000100:00100000:2.0:1788201211.715818:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201211.715995:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614125056 00000100:00100000:0.0:1788201211.716006:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614125056 00010000:00010000:0.0:1788201211.716057:0:6691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d308e expref: 28 pid: 5828 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201211.716099:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 86 00000100:00100000:0.0:1788201211.716109:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006799850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:2348:x1875064614125056:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201211.716169:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201211.716177:0:6691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d308e expref: 28 pid: 5828 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.716190:0:6691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d308e expref: 28 pid: 5828 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.716587:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001680000/0x72011f792b787988 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d308e expref: 28 pid: 5828 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.716605:0:6691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201211.716610:0:6691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787a7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.716620:0:6691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.716627:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787a7d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201211.716668:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201211.716712:0:5828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.716721:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201211.716767:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788201211.716771:0:5828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201211.716790:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.716817:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.716826:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787a6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.716833:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787a6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.716839:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787a6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.716846:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000031800 already unused, calling callback (ffffffffc20cb4f0) 00000100:00100000:0.0:1788201211.716846:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006799850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:2348:x1875064614125056:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 738us (1036us total) trans 0 rc 0/0 00010000:00010000:3.0:1788201211.716850:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787a6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201211.716853:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 86 00010000:00010000:3.0:1788201211.716857:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787a6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.716865:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:3.0:1788201211.716868:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201211.716871:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787a6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.716877:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787a6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.716888:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.716895:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.716907:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.716912:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201211.716915:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.716921:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.716930:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b00109a1400) 00010000:00010000:3.0:1788201211.716933:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201211.716935:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.716940:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787a76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.716974:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30cd expref: 27 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.716987:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787a7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30cd expref: 26 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201211.716994:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:3.0:1788201211.716996:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201211.716999:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000030a00, rc 0) 00000100:00100000:3.0:1788201211.717033:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:11609:x1875064614124672:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 10006us (11634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201211.717050:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 232 00010000:00010000:3.0:1788201212.363263:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788201212.607216:0:12613:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788201212.607226:0:12613:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788201212.607278:0:12613:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788201212.607284:0:12613:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788201212.684323:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788201212.684332:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201212.684366:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788201212.684372:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788201212.684493:0:11684:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b001f914380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875064622492672:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788201212.684599:0:11684:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00081bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201212.692893:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201212.693110:0:11684:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b001f914380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1875064622492672:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788201212.693311:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614125184 00000100:00100000:0.0:1788201212.693324:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614125184 00000100:00100000:0.0:1788201212.693377:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 233 00000100:00100000:0.0:1788201212.693385:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:11621:x1875064614125184:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788201212.693417:0:9471:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788201212.693503:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:11621:x1875064614125184:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 118us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201212.693510:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 233 00000100:00100000:1.0:1788201212.701248:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201212.704316:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614125440 00000100:00100000:0.0:1788201212.704329:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614125440 00000100:00100000:0.0:1788201212.704396:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 234 00000100:00100000:0.0:1788201212.704407:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+26:11621:x1875064614125440:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201212.704431:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201212.704450:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b787a84 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d30d4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201212.704557:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787a8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201212.704571:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201212.704582:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201212.704593:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788201212.704869:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e400/0x72011f792b787a84 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30d4 expref: 29 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201212.704889:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787a8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30d4 expref: 28 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201212.704908:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201212.704911:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201212.704915:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676f800, rc 0) 00000100:00100000:0.0:1788201212.704994:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:11621:x1875064614125440:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 589us (3754us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788201212.705002:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 234 00000100:00100000:3.0:1788201212.709315:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201212.709347:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614125568 00000100:00100000:3.0:1788201212.709355:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614125568 00000100:00100000:3.0:1788201212.709405:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:3.0:1788201212.709414:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:2351:x1875064614125568:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201212.709430:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201212.709452:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b787a8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30d4 expref: 28 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201212.709475:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:3.0:1788201212.709480:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201212.709524:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:2351:x1875064614125568:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 111us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201212.709531:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:1.0:1788201212.714368:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201212.714439:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614125824 00000100:00100000:3.0:1788201212.714449:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614125824 00000100:00100000:3.0:1788201212.714504:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 235 00000100:00100000:3.0:1788201212.714514:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+27:11621:x1875064614125824:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788201212.714604:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201212.714621:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201212.714660:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201212.714850:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201212.714858:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201212.714866:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201212.714872:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201212.714877:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201212.715116:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a99 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201212.715129:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:3.0:1788201212.715163:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788201212.715168:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a99 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201212.715175:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787a99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201212.715314:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:11621:x1875064614125824:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 799us (953us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788201212.715323:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 235 00000040:00080000:3.0:1788201212.715427:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788201212.715431:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788201212.716673:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788201212.716686:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788201212.719896:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201212.720106:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614126080 00000100:00100000:0.0:1788201212.720116:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614126080 00000100:00100000:0.0:1788201212.720212:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 64 00000100:00100000:0.0:1788201212.720222:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+28:11621:x1875064614126080:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788201212.720454:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+29:11621:x1875064614126080:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 232us (575us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788201212.720462:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 64 00000001:00080000:1.0:1788201213.261668:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1788201213.261688:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:2.0:1788201213.388103:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201214.416963:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788201214.454554:0:12665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788201214.454564:0:12665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201214.454629:0:12665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788201214.454637:0:12665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788201214.689300:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201214.689395:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614126336 00000100:00100000:0.0:1788201214.689405:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614126336 00000100:00100000:0.0:1788201214.689484:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 236 00000100:00100000:0.0:1788201214.689494:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+29:11641:x1875064614126336:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788201214.689525:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201214.689545:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b787aa0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d30db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.689659:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b787aa7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.689675:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b787aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.689700:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b787aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201214.689713:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00080000:2.0:1788201214.690004:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788201214.690074:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fe00/0x72011f792b787aa0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30db expref: 32 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.690098:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b787aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30db expref: 31 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.690107:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201214.690109:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788201214.690112:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676e200, rc 0) 00000100:00100000:0.0:1788201214.690282:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:11641:x1875064614126336:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 788us (990us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788201214.690290:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 236 00000100:00100000:0.0:1788201214.701731:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201214.701812:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614126464 00000100:00100000:3.0:1788201214.701834:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614126464 00000100:00100000:3.0:1788201214.701909:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 237 00000100:00100000:3.0:1788201214.701922:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:11641:x1875064614126464:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:3.0:1788201214.702086:0:9471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787ab5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.702108:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.702121:0:9471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.702179:0:9471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.702187:0:9471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787ab5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.702195:0:9471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.702201:0:9471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201214.702206:0:9471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.702213:0:9471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787ab5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.702245:0:9471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:3.0:1788201214.702249:0:9471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201214.702256:0:9471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787ab5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.702264:0:9471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030800/0x72011f792b787ab5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201214.702430:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+31:11641:x1875064614126464:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 510us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201214.702439:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 237 00000100:00100000:2.0:1788201214.748837:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201214.748891:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201214.748930:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201214.748971:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201214.749115:0:12066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614126848 00000100:00100000:3.0:1788201214.749127:0:12066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614126848 00000100:00100000:3.0:1788201214.749237:0:12066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614126720 00000100:00100000:3.0:1788201214.749241:0:12066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614126720 00000100:00100000:3.0:1788201214.749267:0:12066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 73 00000100:00100000:3.0:1788201214.749279:0:12066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2351:x1875064614126848:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201214.749368:0:12066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2351:x1875064614126848:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 91us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201214.749376:0:12066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 73 00000100:00100000:3.0:1788201214.749392:0:12066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 74 00000100:00100000:3.0:1788201214.749398:0:12066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2351:x1875064614126720:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201214.749420:0:12066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2351:x1875064614126720:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 23us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201214.749426:0:12066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 74 00000100:00100000:3.0:1788201214.749451:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614126976 00000100:00100000:3.0:1788201214.749470:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614126976 00000100:00100000:3.0:1788201214.749501:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 146 00000100:00100000:3.0:1788201214.749507:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2351:x1875064614126976:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201214.749534:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2351:x1875064614126976:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 28us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201214.749539:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 146 00000100:00100000:0.0:1788201214.749944:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614126592 00000100:00100000:0.0:1788201214.749949:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614126592 00000100:00100000:0.0:1788201214.749998:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 292 00000100:00100000:0.0:1788201214.750005:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2351:x1875064614126592:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201214.750040:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2351:x1875064614126592:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 37us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201214.750048:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 292 00000100:00080000:2.0:1788201214.751128:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201214.751181:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201214.751184:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201214.877236:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201214.878339:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614127104 00000100:00100000:3.0:1788201214.878349:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614127104 00000100:00100000:3.0:1788201214.878427:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 71 00000100:00100000:3.0:1788201214.878438:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2350:x1875064614127104:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:3.0:1788201214.878458:0:7765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201214.878482:0:7765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d63051f3/0x72011f792b787abc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d30e2 expref: -99 pid: 7765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201214.878511:0:7765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a95c8fa, atime: 0x6a95c8fa, ctime: 0x6a95c8fa, blocks: 0xb 00010000:00010000:3.0:1788201214.878532:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=294s v=(0 0) 00010000:00010000:3.0:1788201214.878537:0:7765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201214.878547:0:7765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d63051f3/0x72011f792b787abc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30e2 expref: 8 pid: 7765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.878567:0:7765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d63051f3/0x72011f792b787abc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30e2 expref: 8 pid: 7765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.878581:0:7765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000030800, rc 0) 00000100:00100000:3.0:1788201214.878659:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2350:x1875064614127104:12345-192.168.203.14@tcp:101:cat.0 Request processed in 223us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201214.878684:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 71 00000100:00100000:1.0:1788201214.890951:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201214.891108:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614127232 00000100:00100000:3.0:1788201214.891123:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614127232 00002000:00100000:3.0:1788201214.891247:0:6683:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9b003b0ae680 x1875064614127232/t0(0) o3->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:335/0 lens 488/0 e 0 to 0 dl 1788201225 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201214.891262:0:6683:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b003b0ae680 with x1875064614127232 ext(0->4095) 00002000:00010000:3.0:1788201214.891270:0:6683:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b003b0ae680 00000100:00100000:3.0:1788201214.891321:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:3.0:1788201214.891333:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2348:x1875064614127232:12345-192.168.203.14@tcp:3:cat.0 00000100:00100000:3.0:1788201214.891674:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+8:2348:x1875064614127232:12345-192.168.203.14@tcp:3:cat.0 Request processed in 341us (739us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788201214.891682:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00002000:00100000:3.0:1788201214.891699:0:6683:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9b003b0ae680 x1875064614127232/t0(0) o3->aa6eef1a-3f03-469a-ac4c-2a406b6709bc@192.168.203.14@tcp:335/0 lens 488/4536 e 0 to 0 dl 1788201225 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201214.891710:0:6683:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b003b0ae680 with x1875064614127232 ext(0->4095) 00002000:00010000:3.0:1788201214.891714:0:6683:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b003b0ae680 00010000:00010000:3.0:1788201215.435299:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201215.759281:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201215.759303:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003fad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622492800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201215.759369:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201215.759669:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622492800 00000100:00100000:2.0:1788201215.759679:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622492800 00000100:00100000:2.0:1788201215.759748:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788201215.759757:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622492800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201215.759791:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201215.759834:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622492800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201215.759840:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788201215.759972:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201215.760030:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622493312:0@lo:400:kworker.0 00000100:00100000:0.0:1788201215.760064:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201215.760113:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201215.760118:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1875064622493184:0@lo:400:kworker.0 00000100:00100000:0.0:1788201215.760163:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201215.760292:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622493184 00000100:00100000:1.0:1788201215.760297:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622493184 00000100:00100000:1.0:1788201215.760340:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788201215.760346:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875064622493184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201215.760399:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875064622493184:12345-0@lo:400:kworker.0 Request processed in 53us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201215.760405:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788201215.760561:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622492928:0@lo:400:kworker.0 00000100:00100000:3.0:1788201215.760594:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201215.760634:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1875064622493440:0@lo:400:kworker.0 00000100:00100000:3.0:1788201215.760657:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201215.760686:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201215.760692:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622493056:0@lo:400:kworker.0 00000100:00100000:3.0:1788201215.760713:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201215.760741:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622493440 00000100:00100000:3.0:1788201215.760745:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622493440 00000100:00100000:3.0:1788201215.760770:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622493056 00000100:00100000:3.0:1788201215.760773:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622493056 00000100:00100000:3.0:1788201215.760793:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788201215.760799:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875064622493440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201215.760836:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875064622493440:12345-0@lo:400:kworker.0 Request processed in 37us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201215.760842:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788201215.760855:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788201215.760874:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622493056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201215.760901:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622493056:12345-0@lo:400:kworker.0 Request processed in 29us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201215.760906:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788201215.760939:0:3292:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788201215.760945:0:3292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1788201215.760962:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b003b0ac700, transno 4294967310 00000100:00100000:3.0:1788201215.760982:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003fad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622492800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201215.761209:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622493056:0@lo:400:kworker.0 00000100:00100000:3.0:1788201215.761219:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1875064622493440:0@lo:400:kworker.0 00000100:00080000:0.0:1788201215.761425:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201215.761448:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1875064622493184:0@lo:400:kworker.0 00000100:00100000:1.0:1788201215.762992:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622492928 00000100:00100000:1.0:1788201215.763004:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622492928 00000100:00100000:1.0:1788201215.763072:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788201215.763081:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622492928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201215.763223:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622492928:12345-0@lo:400:kworker.0 Request processed in 143us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201215.763230:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788201215.763281:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622492928:0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.763974:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622493312 00000100:00100000:2.0:1788201215.763980:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622493312 00000100:00100000:2.0:1788201215.764038:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788201215.764060:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b000884ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3293:x1875064622493312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201215.764124:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b000884ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3293:x1875064622493312:12345-0@lo:400:kworker.0 Request processed in 65us (4058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201215.764130:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788201215.764626:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622493312:0@lo:400:kworker.0 00000100:00080000:1.0:1788201215.764954:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201216.459341:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201216.788961:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003fad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622493568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201216.789307:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201216.789495:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622493568 00000100:00100000:2.0:1788201216.789505:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622493568 00000100:00100000:2.0:1788201216.789563:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788201216.789575:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1875064622493568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201216.790505:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201216.790595:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1875064622493568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1020us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201216.790614:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788201216.793363:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003fad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622493568:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788201216.890004:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1788201216.890024:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1788201216.920479:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1788201216.920527:0:5849:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b000a759c00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788201216.920535:0:5849:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b0035db6700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b000a7599c0 00000020:00080000:0.0:1788201216.920539:0:5849:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b0035db6f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b003f537c00 00000020:00080000:1.0:1788201216.922519:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:0.0:1788201216.922800:0:5849:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1788201216.923369:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1788201217.485380:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788201217.870328:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788201217.870338:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788201217.870377:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788201217.870461:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788201218.519982:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201219.531378:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201219.873821:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201219.873927:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201219.873979:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201219.874012:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201219.874050:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201219.874465:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614127872 00000100:00100000:2.0:1788201219.874481:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614127872 00000100:00080000:1.0:1788201219.874610:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201219.874704:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614127488 00000100:00100000:2.0:1788201219.874709:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614127488 00000100:00100000:2.0:1788201219.874748:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 150 00000100:00100000:2.0:1788201219.874829:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2349:x1875064614127872:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201219.874845:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 151 00000100:00100000:1.0:1788201219.874870:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+18:2349:x1875064614127488:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201219.874951:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:2349:x1875064614127872:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 125us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201219.874961:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 150 00000100:00100000:1.0:1788201219.874983:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+18:2349:x1875064614127488:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 121us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201219.874994:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 151 00000100:00100000:2.0:1788201219.875022:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614127616 00000100:00100000:2.0:1788201219.875030:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614127616 00000100:00080000:1.0:1788201219.875033:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201219.875083:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614127744 00000100:00100000:2.0:1788201219.875090:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614127744 00000100:00100000:2.0:1788201219.875127:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 76 00000100:00100000:2.0:1788201219.875178:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2349:x1875064614127616:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201219.875420:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2349:x1875064614127616:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 286us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201219.875428:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 76 00000100:00100000:2.0:1788201219.875444:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 77 00000100:00100000:2.0:1788201219.875450:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2349:x1875064614127744:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201219.875474:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2349:x1875064614127744:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 24us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201219.875481:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 77 00000100:00080000:2.0:1788201219.875569:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201219.875576:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201219.884747:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614127360 00000100:00100000:3.0:1788201219.884768:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614127360 00000100:00100000:3.0:1788201219.884857:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 294 00000100:00100000:3.0:1788201219.884870:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2349:x1875064614127360:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201219.884994:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2349:x1875064614127360:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 126us (11188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201219.885003:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 294 00000100:00100000:1.0:1788201220.073988:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201220.074083:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614128000 00000100:00100000:2.0:1788201220.074092:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614128000 00000100:00100000:2.0:1788201220.074294:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 238 00000100:00100000:2.0:1788201220.074306:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+18:11286:x1875064614128000:12345-192.168.203.14@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788201220.074502:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+18:11286:x1875064614128000:12345-192.168.203.14@tcp:60:lhsmtool_posix.0 Request processed in 198us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201220.074510:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 238 00000100:00100000:0.0:1788201220.087904:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201220.088278:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614128256 00000100:00100000:3.0:1788201220.088288:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614128256 00000100:00100000:3.0:1788201220.088384:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 65 00000100:00100000:3.0:1788201220.088395:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+18:11286:x1875064614128256:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788201220.088985:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:11286:x1875064614128256:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 589us (1088us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788201220.088994:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 65 00000100:00100000:1.0:1788201220.281313:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201220.281475:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614128384 00000100:00100000:3.0:1788201220.281494:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614128384 00000100:00100000:3.0:1788201220.281596:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 239 00000100:00100000:3.0:1788201220.281610:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+5:12092:x1875064614128384:12345-192.168.203.14@tcp:101:lsof.0 00010000:00010000:3.0:1788201220.281645:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201220.281677:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787ac3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d30e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201220.281781:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787aca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201220.281820:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787aca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201220.281837:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787aca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201220.282348:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788201220.282355:0:5828:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201220.282460:0:5828:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787aca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201220.282496:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030200/0x72011f792b787ac3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30e9 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201220.282519:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787aca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30e9 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201220.282530:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00109a1f00) 00010000:00010000:3.0:1788201220.282533:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201220.282537:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000031800, rc 0) 00000100:00100000:3.0:1788201220.282888:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+6:12092:x1875064614128384:12345-192.168.203.14@tcp:101:lsof.0 Request processed in 1279us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201220.282898:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 239 00010000:00010000:3.0:1788201220.557598:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201220.878269:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003fad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622493696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201220.878384:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201220.878670:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622494080:0@lo:400:kworker.0 00000100:00100000:3.0:1788201220.878711:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201220.878736:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201220.878741:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622493952:0@lo:400:kworker.0 00000100:00100000:3.0:1788201220.878782:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201220.878815:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622494080 00000100:00100000:3.0:1788201220.878822:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622494080 00000100:00100000:3.0:1788201220.878879:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622493952 00000100:00100000:3.0:1788201220.878883:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622493952 00000100:00100000:3.0:1788201220.878906:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788201220.878917:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622494080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201220.878979:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622494080:12345-0@lo:400:kworker.0 Request processed in 64us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201220.878987:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788201220.879004:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788201220.879011:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622493952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201220.879036:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622493952:12345-0@lo:400:kworker.0 Request processed in 26us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201220.879041:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788201220.879081:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622493952:0@lo:400:kworker.0 00000100:00100000:3.0:1788201220.879092:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622494080:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.879196:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622494208:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.879229:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201220.879263:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788201220.879277:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622493824:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.879312:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201220.879334:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622494336:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.879357:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201220.879385:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622493824 00000100:00100000:0.0:1788201220.879388:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622493824 00000100:00100000:0.0:1788201220.879419:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788201220.879425:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622493824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.879465:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622493824:12345-0@lo:400:kworker.0 Request processed in 40us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201220.879471:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788201220.879501:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622494336 00000100:00100000:0.0:1788201220.879504:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622494336 00000100:00100000:0.0:1788201220.879523:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788201220.879529:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622494336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.879555:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622494336:12345-0@lo:400:kworker.0 Request processed in 27us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201220.879561:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788201220.879596:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622493824:0@lo:400:kworker.0 00000100:00100000:0.0:1788201220.879606:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622494336:0@lo:400:kworker.0 00000100:00100000:3.0:1788201220.879824:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622494208 00000100:00100000:3.0:1788201220.879829:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622494208 00000100:00100000:3.0:1788201220.879872:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788201220.879880:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622494208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201220.879927:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622494208:12345-0@lo:400:kworker.0 Request processed in 48us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201220.879934:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788201220.880000:0:3292:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788201220.880008:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b003f435500, transno 4294967322 00000004:00080000:1.0:1788201220.880025:0:3292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788201220.880044:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622494208:0@lo:400:kworker.0 00000100:00100000:2.0:1788201220.881175:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622493696 00000100:00100000:2.0:1788201220.881188:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622493696 00000100:00100000:2.0:1788201220.881249:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788201220.881261:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00407d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622493696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201220.881301:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201220.881376:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00407d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622493696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (2992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201220.881383:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788201220.881633:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201220.881638:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201220.881641:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201220.881878:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003fad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622493696:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788201221.579729:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201221.907965:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622494464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201221.908071:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201221.909332:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622494464 00000100:00100000:3.0:1788201221.909348:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622494464 00000100:00100000:3.0:1788201221.909449:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788201221.909461:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622494464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201221.909520:0:6679:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201221.914329:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622494464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4853us (6242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201221.914350:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788201221.923284:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622494464:0@lo:13:osp-pre-0-0.0 00000020:00080000:0.0:1788201221.961338:0:5849:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1788201221.961376:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1788201221.961503:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788201221.961517:0:5861:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788201222.603402:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201223.643317:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201224.004539:0:12867:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:33:42 (1788201222) 00010000:00010000:3.0:1788201224.653122:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201224.987011:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201224.987060:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201224.987100:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201224.987125:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201224.987191:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201224.987229:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614128512 00000100:00100000:2.0:1788201224.987242:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614128512 00000100:00100000:2.0:1788201224.987310:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 296 00000100:00100000:2.0:1788201224.987322:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2351:x1875064614128512:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201224.987435:0:12066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614128896 00000100:00100000:1.0:1788201224.987440:0:12066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614128896 00000100:00100000:1.0:1788201224.987489:0:12066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614128768 00000100:00100000:1.0:1788201224.987493:0:12066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614128768 00000100:00100000:1.0:1788201224.987519:0:12066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 79 00000100:00100000:1.0:1788201224.987527:0:12066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2351:x1875064614128896:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201224.987628:0:12066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2351:x1875064614128896:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 102us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201224.987637:0:12066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 79 00000100:00100000:1.0:1788201224.987658:0:12066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 80 00000100:00100000:1.0:1788201224.987677:0:12066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2351:x1875064614128768:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788201224.987706:0:12066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2351:x1875064614128768:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 31us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201224.987725:0:12066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 80 00000100:00100000:2.0:1788201224.988062:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2351:x1875064614128512:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 741us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201224.988070:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 296 00000100:00100000:2.0:1788201224.988110:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614128640 00000100:00100000:2.0:1788201224.988115:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614128640 00000100:00100000:2.0:1788201224.988172:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614129024 00000100:00100000:2.0:1788201224.988175:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614129024 00000100:00100000:2.0:1788201224.988198:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 155 00000100:00100000:2.0:1788201224.988205:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+18:2351:x1875064614128640:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201224.988243:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+18:2351:x1875064614128640:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 38us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201224.988249:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 155 00000100:00100000:2.0:1788201224.988262:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 156 00000100:00100000:2.0:1788201224.988279:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+6:2351:x1875064614129024:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201224.988307:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+6:2351:x1875064614129024:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 29us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201224.988313:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 156 00000100:00080000:2.0:1788201224.988686:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201224.988693:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201224.988695:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201225.680283:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201225.995699:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201225.995733:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003fad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622494592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201225.995825:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201225.996041:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622494592 00000100:00100000:1.0:1788201225.996053:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622494592 00000100:00100000:1.0:1788201225.996166:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201225.996182:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622494592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201225.996234:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201225.996295:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622494592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201225.996305:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201225.996343:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622494720:0@lo:400:kworker.0 00000100:00100000:1.0:1788201225.996383:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201225.996411:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622495232:0@lo:400:kworker.0 00000100:00100000:1.0:1788201225.996441:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201225.996462:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201225.996471:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622494848:0@lo:400:kworker.0 00000100:00100000:1.0:1788201225.996498:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201225.996535:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622494720 00000100:00100000:1.0:1788201225.996548:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622494720 00000100:00100000:1.0:1788201225.996590:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788201225.996599:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622494720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201225.996638:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622494720:12345-0@lo:400:kworker.0 Request processed in 40us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201225.996662:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788201225.996691:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622495232 00000100:00100000:1.0:1788201225.996694:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622495232 00000100:00100000:1.0:1788201225.996720:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622494848 00000100:00100000:1.0:1788201225.996723:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622494848 00000100:00100000:1.0:1788201225.996739:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788201225.996745:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622495232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201225.996775:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622495232:12345-0@lo:400:kworker.0 Request processed in 31us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201225.996782:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788201225.996795:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788201225.996802:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622494848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201225.996827:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622494848:12345-0@lo:400:kworker.0 Request processed in 26us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201225.996834:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788201225.996859:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622495104:0@lo:400:kworker.0 00000100:00100000:1.0:1788201225.996891:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201225.996933:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201225.996939:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622494976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201225.996962:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201225.996985:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622494976 00000100:00100000:1.0:1788201225.996988:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622494976 00000100:00100000:3.0:1788201225.997008:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622495104 00000100:00100000:3.0:1788201225.997014:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622495104 00000100:00100000:1.0:1788201225.997018:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788201225.997027:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622494976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201225.997056:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788201225.997068:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875064622494976:12345-0@lo:400:kworker.0 Request processed in 41us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201225.997069:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622495104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201225.997092:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788201225.997118:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622495104:12345-0@lo:400:kworker.0 Request processed in 53us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201225.997126:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788201225.997172:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1875064622494976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201225.997186:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622495104:0@lo:400:kworker.0 00000100:00100000:1.0:1788201225.997218:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622494848:0@lo:400:kworker.0 00000100:00100000:1.0:1788201225.997228:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622494720:0@lo:400:kworker.0 00000100:00100000:1.0:1788201225.997239:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622495232:0@lo:400:kworker.0 00000100:00080000:2.0:1788201225.997441:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201225.997447:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201225.997450:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201225.997491:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003fad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622494592:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788201226.701317:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201227.020184:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622495360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201227.020288:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201227.020462:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622495360 00000100:00100000:1.0:1788201227.020473:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622495360 00000100:00100000:1.0:1788201227.020572:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788201227.020584:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622495360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201227.020630:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201227.020691:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622495360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201227.020700:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788201227.020758:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622495360:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201227.021211:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788201227.083573:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788201227.083589:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201227.084606:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788201227.084619:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788201227.723359:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201227.739967:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201227.740049:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614129280 00000100:00100000:3.0:1788201227.740059:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614129280 00000100:00080000:2.0:1788201227.740182:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201227.740474:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 66 00000100:00100000:3.0:1788201227.740488:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+18:12313:x1875064614129280:12345-192.168.203.14@tcp:35:umount.0 00000100:00100000:3.0:1788201227.741003:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:12313:x1875064614129280:12345-192.168.203.14@tcp:35:umount.0 Request processed in 518us (1045us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788201227.741012:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 66 00000100:00100000:1.0:1788201227.744203:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201227.744296:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614129536 00000100:00100000:0.0:1788201227.744305:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614129536 00000100:00100000:0.0:1788201227.744370:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00100000:0.0:1788201227.744389:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+19:12313:x1875064614129536:12345-192.168.203.14@tcp:35:umount.0 00000100:00100000:0.0:1788201227.745223:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:12313:x1875064614129536:12345-192.168.203.14@tcp:35:umount.0 Request processed in 839us (1025us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788201227.745234:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00100000:1.0:1788201227.749813:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201227.749905:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614129792 00000100:00100000:3.0:1788201227.749914:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614129792 00000100:00100000:3.0:1788201227.750175:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 68 00000100:00100000:3.0:1788201227.750186:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002289f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+20:12313:x1875064614129792:12345-192.168.203.14@tcp:35:umount.0 00000100:00100000:3.0:1788201227.751403:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002289f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:12313:x1875064614129792:12345-192.168.203.14@tcp:35:umount.0 Request processed in 1213us (1594us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788201227.751413:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 68 00000100:00100000:2.0:1788201227.764217:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201227.774413:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614130048 00000100:00100000:0.0:1788201227.774430:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614130048 00000100:00100000:0.0:1788201227.774504:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:0.0:1788201227.774514:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:12313:x1875064614130048:12345-192.168.203.14@tcp:35:umount.0 00000100:00100000:0.0:1788201227.774890:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:12313:x1875064614130048:12345-192.168.203.14@tcp:35:umount.0 Request processed in 377us (10680us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788201227.774897:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:1.0:1788201227.784410:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201227.784452:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201227.784580:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614130304 00000100:00100000:0.0:1788201227.784589:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614130304 00000100:00100000:0.0:1788201227.784658:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:0.0:1788201227.784678:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2350:x1875064614130304:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201227.784694:0:6691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201227.784712:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00029c7600/0x72011f792b786aa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c3c expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201227.784730:0:6691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201227.784783:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:2350:x1875064614130304:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 107us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201227.784791:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:1.0:1788201227.785050:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201227.785085:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201227.785109:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614130176 00000100:00100000:1.0:1788201227.785113:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614130176 00000100:00100000:1.0:1788201227.785192:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614130432 00000100:00100000:1.0:1788201227.785196:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614130432 00000100:00100000:1.0:1788201227.785212:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:1.0:1788201227.785219:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79fcbf4-8d24-427b-827f-6b1cb026b088+13:2350:x1875064614130176:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201227.785227:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201227.785238:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b001f8f1400/0x72011f792b786ae0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c74 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201227.785253:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201227.785278:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79fcbf4-8d24-427b-827f-6b1cb026b088+12:2350:x1875064614130176:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 59us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201227.785286:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:2.0:1788201227.785288:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614130560 00000100:00100000:2.0:1788201227.785292:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614130560 00000100:00100000:1.0:1788201227.785301:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:1.0:1788201227.785306:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79fcbf4-8d24-427b-827f-6b1cb026b088+11:2350:x1875064614130432:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201227.785312:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201227.785321:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b000676e800/0x72011f792b786d56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d3f expref: 11 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201227.785329:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201227.785333:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 72 00000100:00100000:1.0:1788201227.785347:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79fcbf4-8d24-427b-827f-6b1cb026b088+10:2350:x1875064614130432:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 41us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201227.785348:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2347:x1875064614130560:12345-192.168.203.14@tcp:9:umount.0 00000100:00100000:1.0:1788201227.785354:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 21 00000020:00000080:2.0:1788201227.785387:0:6677:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786e1a 00000100:00080000:2.0:1788201227.785399:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9b0035dcc800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788201227.785439:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:2.0:1788201227.785500:0:6677:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1788201227.785927:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201227.786659:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+2:2347:x1875064614130560:12345-192.168.203.14@tcp:9:umount.0 Request processed in 1306us (2200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201227.786846:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 72 00000100:00100000:3.0:1788201227.791976:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201227.793194:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614130944 00000100:00100000:2.0:1788201227.793206:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614130944 00000100:00100000:2.0:1788201227.793286:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 73 00000100:00100000:2.0:1788201227.793297:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+7:2347:x1875064614130944:12345-192.168.203.14@tcp:9:umount.0 00000020:00000080:2.0:1788201227.793330:0:6675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b787082 00000020:00010000:2.0:1788201227.793337:0:6675:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b0003202800: total 0 00000100:00080000:2.0:1788201227.793342:0:6675:0:(import.c:65:import_set_state_nolock()) ffff9b0003201000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201227.793402:0:6675:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788201227.793703:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+5:2347:x1875064614130944:12345-192.168.203.14@tcp:9:umount.0 Request processed in 408us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201227.793712:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 73 00000020:00010000:0.0:1788201227.794478:0:5815:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b0003202800: total 0 00010000:00010000:0.0:1788201227.794522:0:5815:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b0003202800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788201227.794594:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d63051f3/0x72011f792b787abc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30e2 expref: 4 pid: 7765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201227.794635:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061a41cd1/0x72011f792b78741e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f14 expref: 3 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201227.794649:0:5815:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b0003202800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788201227.794660:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201227.794663:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201227.794664:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201227.795056:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201227.809130:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201227.809267:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614131968 00000100:00100000:2.0:1788201227.809277:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614131968 00000100:00100000:2.0:1788201227.809429:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 240 00000100:00100000:2.0:1788201227.809439:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+22:2347:x1875064614131968:12345-192.168.203.14@tcp:39:umount.0 00000020:00000080:2.0:1788201227.809473:0:5829:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786ab6 00000020:00010000:2.0:1788201227.809490:0:5829:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b003f8ef000: total 0 00000100:00080000:2.0:1788201227.809495:0:5829:0:(import.c:65:import_set_state_nolock()) ffff9b003f8ee000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201227.809575:0:5829:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1788201227.810301:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa6eef1a-3f03-469a-ac4c-2a406b6709bc+21:2347:x1875064614131968:12345-192.168.203.14@tcp:39:umount.0 Request processed in 860us (1176us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788201227.810455:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 240 00000020:00010000:0.0:1788201227.814772:0:8451:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b003f8ef000: total 0 00010000:00010000:0.0:1788201227.814838:0:8451:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b003f8ef000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788201227.814875:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:0.0:1788201227.814879:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788201227.814890:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031000/0x72011f792b78777b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3009 expref: 20 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201227.814912:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201227.814915:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788201227.814918:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e200/0x72011f792b787aa7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30db expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201227.815252:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b00109a1100) 00010000:00010000:0.0:1788201227.815256:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201227.815262:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fce00/0x72011f792b786d80 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d4d expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201227.815304:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:0.0:1788201227.815307:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788201227.815311:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7000/0x72011f792b787409 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f0d expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201227.815324:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:0.0:1788201227.815326:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201227.815329:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7e00/0x72011f792b7872ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2ec7 expref: 16 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201227.815339:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:0.0:1788201227.815341:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788201227.815344:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00126fc200/0x72011f792b786df0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d69 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201227.815355:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201227.815357:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201227.815361:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676fc00/0x72011f792b78799d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3095 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201227.815374:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b00109a1b00) 00010000:00010000:0.0:1788201227.815376:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788201227.815380:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0001681600/0x72011f792b7870dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2e3b expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201227.815393:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b00109a1800) 00010000:00010000:0.0:1788201227.815395:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788201227.815405:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7a00/0x72011f792b78749c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f37 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201227.815423:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b0002a80900) 00010000:00010000:0.0:1788201227.815426:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201227.815429:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000030a00/0x72011f792b787a7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30cd expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201227.815442:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00109a1f00) 00010000:00010000:0.0:1788201227.815444:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201227.815447:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b00029c7800/0x72011f792b787480 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2f30 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201227.815458:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b0011cb3e00) 00010000:00010000:0.0:1788201227.815460:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201227.815464:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b786d9c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d54 expref: 9 pid: 9471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201227.815478:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b00033b2500) 00010000:00010000:0.0:1788201227.815481:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201227.815485:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7873df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2eff expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201227.815498:0:8451:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b003f8ef000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788201227.815513:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201227.815515:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201227.815517:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788201228.606050:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa6eef1a-3f03-469a-ac4c-2a406b6709bc 00000020:00000080:2.0:1788201228.606059:0:7643:0:(genops.c:906:class_export_put()) final put ffff9b0035dcd800/aa6eef1a-3f03-469a-ac4c-2a406b6709bc 00000020:00000080:0.0:1788201228.606220:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0035dcd800/aa6eef1a-3f03-469a-ac4c-2a406b6709bc for lustre-OST0001 00000020:00000080:0.0:1788201228.606384:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b0035dcc800 for lustre-OST0001 00010000:00010000:3.0:1788201228.747375:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201229.550913:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201229.550982:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201229.551176:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614132224 00000100:00100000:2.0:1788201229.551187:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614132224 00000100:00100000:2.0:1788201229.551248:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614132096 00000100:00100000:2.0:1788201229.551252:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614132096 00000100:00100000:2.0:1788201229.551290:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:2.0:1788201229.551301:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79fcbf4-8d24-427b-827f-6b1cb026b088+11:2349:x1875064614132224:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201229.551317:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788201229.551326:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 23 00010000:00010000:2.0:1788201229.551342:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b000676e600/0x72011f792b786b8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2cb3 expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201229.551355:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79fcbf4-8d24-427b-827f-6b1cb026b088+11:2349:x1875064614132096:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201229.551366:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201229.551378:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201229.551405:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00126fda00/0x72011f792b786b88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c89 expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201229.551424:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79fcbf4-8d24-427b-827f-6b1cb026b088+9:2349:x1875064614132224:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 122us (518us total) trans 0 rc 0/0 00010000:00010000:3.0:1788201229.551426:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201229.551437:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:3.0:1788201229.551600:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79fcbf4-8d24-427b-827f-6b1cb026b088+8:2349:x1875064614132096:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 257us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201229.551610:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:3.0:1788201229.563750:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201229.563902:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614132352 00000100:00100000:2.0:1788201229.563918:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614132352 00000100:00100000:2.0:1788201229.564010:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:2.0:1788201229.564021:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0006799050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79fcbf4-8d24-427b-827f-6b1cb026b088+8:2349:x1875064614132352:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201229.564037:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201229.564055:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b000676ea00/0x72011f792b786d4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2d38 expref: 8 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201229.564073:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201229.564213:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0006799050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79fcbf4-8d24-427b-827f-6b1cb026b088+7:2349:x1875064614132352:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 193us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201229.564220:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:1.0:1788201229.565769:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201229.567191:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614132608 00000100:00100000:2.0:1788201229.567206:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614132608 00000100:00100000:2.0:1788201229.567311:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 241 00000100:00080000:3.0:1788201229.567316:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201229.567326:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+6:2347:x1875064614132608:12345-192.168.203.14@tcp:39:umount.0 00000020:00000080:2.0:1788201229.567373:0:5828:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786b9d 00000020:00010000:2.0:1788201229.567380:0:5828:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b003f3c1000: total 0 00000100:00080000:2.0:1788201229.567384:0:5828:0:(import.c:65:import_set_state_nolock()) ffff9b003f3c6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201229.567413:0:5828:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:3.0:1788201229.567496:0:8450:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b003f3c1000: total 0 00010000:00010000:3.0:1788201229.567596:0:8450:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b003f3c1000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788201229.567651:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b00109a1f00) 00010000:00010000:3.0:1788201229.567657:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201229.567670:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0000031800/0x72011f792b787aca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30e9 expref: 5 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201229.567748:0:8450:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b003f3c1000, canceled 1 locks, left on hash table 0. 00000100:00100000:2.0:1788201229.567748:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e1fa00b-ddbb-4133-8a19-496b22d710da+4:2347:x1875064614132608:12345-192.168.203.14@tcp:39:umount.0 Request processed in 423us (1985us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1788201229.567769:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 241 00010000:00010000:3.0:1788201229.567772:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201229.567777:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201229.567779:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201229.605214:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201229.605349:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614132864 00000100:00100000:2.0:1788201229.605362:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614132864 00000100:00100000:2.0:1788201229.605430:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 298 00000100:00100000:2.0:1788201229.605448:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+7:2347:x1875064614132864:12345-192.168.203.14@tcp:251:umount.0 00000020:00000080:2.0:1788201229.605507:0:5822:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786a93 00000020:00010000:2.0:1788201229.605526:0:5822:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b0035c0c800: total 0 00000100:00080000:2.0:1788201229.605532:0:5822:0:(import.c:65:import_set_state_nolock()) ffff9b0035c09800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788201229.605627:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79fcbf4-8d24-427b-827f-6b1cb026b088+3:2347:x1875064614132864:12345-192.168.203.14@tcp:251:umount.0 Request processed in 186us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201229.605636:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 298 00000020:00010000:0.0:1788201229.605818:0:5815:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b0035c0c800: total 0 00010000:00010000:0.0:1788201229.605824:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201229.605888:0:5815:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b0035c0c800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788201229.605936:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00126fc600/0x72011f792b786ae7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d2c7b expref: 2 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201229.605957:0:5815:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b0035c0c800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788201229.605968:0:5815:0:(genops.c:906:class_export_put()) final put ffff9b0035c0c800/e79fcbf4-8d24-427b-827f-6b1cb026b088 00010000:00010000:0.0:1788201229.605985:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201229.605987:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201229.605989:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201229.606873:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0035c0c800/e79fcbf4-8d24-427b-827f-6b1cb026b088 for MGS 00000020:00000080:2.0:1788201229.606936:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b0035c09800 for MGS 00010000:00010000:2.0:1788201229.771571:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201230.795850:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201231.115422:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622495744:0@lo:400:kworker.0 00000100:00100000:3.0:1788201231.115534:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201231.115616:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201231.115623:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622495872:0@lo:400:kworker.0 00000100:00100000:3.0:1788201231.115652:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201231.115695:0:9471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622495744 00000100:00100000:3.0:1788201231.115705:0:9471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622495744 00000100:00100000:3.0:1788201231.115771:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788201231.115782:0:9471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622495744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201231.115843:0:9471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622495744:12345-0@lo:400:kworker.0 Request processed in 63us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.115850:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788201231.115888:0:7765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622495872 00000100:00100000:3.0:1788201231.115891:0:7765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622495872 00000100:00100000:3.0:1788201231.115921:0:7765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788201231.115927:0:7765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622495872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201231.115958:0:7765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1875064622495872:12345-0@lo:400:kworker.0 Request processed in 31us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.115964:0:7765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788201231.115982:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201231.115987:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201231.116044:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622495872:0@lo:400:kworker.0 00000100:00100000:3.0:1788201231.116056:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622495744:0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.116309:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622495488:0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.116351:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201231.116377:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1875064622496000:0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.116404:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201231.116426:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788201231.116431:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622495616:0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.116455:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201231.116473:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622496128:0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.116495:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201231.116533:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622496000 00000100:00100000:2.0:1788201231.116537:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622496000 00000100:00100000:2.0:1788201231.116564:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622495616 00000100:00100000:2.0:1788201231.116567:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622495616 00000100:00100000:2.0:1788201231.116580:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788201231.116586:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875064622496000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.116623:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875064622496000:12345-0@lo:400:kworker.0 Request processed in 37us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.116630:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788201231.116643:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788201231.116649:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622495616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.116673:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622495616:12345-0@lo:400:kworker.0 Request processed in 24us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.116679:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788201231.116702:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622496128 00000100:00100000:2.0:1788201231.116705:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622496128 00000100:00100000:2.0:1788201231.116732:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788201231.116740:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622496128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.116780:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622496128:12345-0@lo:400:kworker.0 Request processed in 41us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.116787:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788201231.116817:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622495616:0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.116828:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622496128:0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.116837:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1875064622496000:0@lo:400:kworker.0 00000100:00100000:3.0:1788201231.117155:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622495488 00000100:00100000:3.0:1788201231.117160:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622495488 00000100:00100000:3.0:1788201231.117193:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788201231.117200:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00057e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622495488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201231.117239:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00057e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16f590af-689d-4459-b486-809c9db65822+19:3294:x1875064622495488:12345-0@lo:400:kworker.0 Request processed in 40us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.117246:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788201231.117276:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201231.118407:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622496256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201231.118466:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201231.118517:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201231.118524:0:5823:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201231.118560:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622495488:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.118838:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622496256 00000100:00100000:1.0:1788201231.118846:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622496256 00000100:00100000:1.0:1788201231.118906:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788201231.118916:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622496256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201231.118961:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201231.119013:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622496256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201231.119021:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788201231.119061:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622496256:0@lo:13:osp-pre-1-0.0 00000020:01000004:0.0:1788201231.543574:0:13064:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1788201231.558309:0:13064:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788201231.558369:0:13064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b786b26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b2d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.558387:0:13064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b786b26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786b2d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.558394:0:13064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b786b26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786b2d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.558402:0:13064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b786b26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786b2d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.558440:0:13064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788201231.558447:0:13064:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788201231.558472:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201231.558478:0:13064:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788201231.558484:0:13064:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788201231.558528:0:13064:0:(import.c:65:import_set_state_nolock()) ffff9b0026f5f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788201231.558681:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201231.558691:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b786b26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786b2d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.558700:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fd000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1788201231.558703:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b786b26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786b2d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.558713:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b786b26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x72011f792b786b2d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201231.558721:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b786b26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x72011f792b786b2d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201231.558736:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201231.558739:0:8450:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788201231.558741:0:8450:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788201231.558776:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b786b26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x72011f792b786b2d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.558784:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201231.558826:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b786b26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x72011f792b786b2d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.558834:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b00126fd000/0x72011f792b786b26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x72011f792b786b2d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.558848:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201231.558850:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201231.558851:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201231.558860:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201231.558885:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622496512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201231.558989:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201231.559075:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622496512 00000100:00100000:3.0:1788201231.559083:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622496512 00000100:00100000:3.0:1788201231.559178:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201231.559194:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+19:3292:x1875064622496512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201231.559211:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201231.559230:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00126fd200/0x72011f792b786b2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72011f792b786b26 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.559244:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201231.559292:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+18:3292:x1875064622496512:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.559300:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201231.559348:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622496512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201231.559393:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875064622496384:0@lo:39:umount.0 00000100:00100000:3.0:1788201231.559441:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201231.559483:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622496384 00000100:00100000:3.0:1788201231.559487:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622496384 00000100:00100000:3.0:1788201231.559529:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788201231.559536:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875064622496384:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788201231.559564:0:5829:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b7868a2 00000100:00080000:3.0:1788201231.559573:0:5829:0:(import.c:65:import_set_state_nolock()) ffff9b0026fec000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788201231.559636:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3291:x1875064622496384:12345-0@lo:39:umount.0 Request processed in 100us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.559643:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1788201231.559650:0:5829:0:(genops.c:906:class_export_put()) final put ffff9b0026f92800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788201231.559679:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201231.559700:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b0026f5f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788201231.559709:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875064622496384:0@lo:39:umount.0 00000020:00000080:3.0:1788201231.559745:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0026f92800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201231.559813:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b0026fec000 for lustre-MDT0000 00000100:00080000:0.0:1788201231.560280:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201231.560284:0:13064:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788201231.560289:0:13064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788201231.562797:0:13064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0c00/0x72011f792b786b34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b3b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.564658:0:13064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0c00/0x72011f792b786b34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786b3b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.564668:0:13064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0c00/0x72011f792b786b34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786b3b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.564677:0:13064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0c00/0x72011f792b786b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786b3b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.565254:0:13064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201231.565268:0:13064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000030400/0x72011f792b786a4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786a54 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.565279:0:13064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000030400/0x72011f792b786a4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786a54 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.565286:0:13064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000030400/0x72011f792b786a4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786a54 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.565293:0:13064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff9b0000030400/0x72011f792b786a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786a54 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.571547:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201231.571570:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0c00/0x72011f792b786b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786b3b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.571586:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0c00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1788201231.571591:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0c00/0x72011f792b786b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786b3b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.571626:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0c00/0x72011f792b786b34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x72011f792b786b3b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201231.571635:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0c00/0x72011f792b786b34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x72011f792b786b3b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201231.571641:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201231.571644:0:8451:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788201231.571735:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0c00/0x72011f792b786b34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x72011f792b786b3b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.571742:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201231.571784:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0c00/0x72011f792b786b34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x72011f792b786b3b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.571792:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0c00/0x72011f792b786b34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x72011f792b786b3b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201231.571825:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622496640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201231.571912:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201231.572121:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622496640 00000100:00100000:3.0:1788201231.572130:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622496640 00000100:00100000:3.0:1788201231.572293:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788201231.572304:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16f590af-689d-4459-b486-809c9db65822+18:3294:x1875064622496640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201231.572323:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201231.572341:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b001f8f0800/0x72011f792b786b3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72011f792b786b34 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.572370:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201231.572413:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16f590af-689d-4459-b486-809c9db65822+17:3294:x1875064622496640:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.572422:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788201231.573122:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622496640:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201231.573243:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201231.573250:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0000030400/0x72011f792b786a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786a54 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.573261:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030400 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1788201231.573266:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0000030400/0x72011f792b786a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786a54 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.573276:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0000030400/0x72011f792b786a4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x72011f792b786a54 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201231.573284:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0000030400/0x72011f792b786a4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x72011f792b786a54 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201231.573290:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201231.573294:0:8451:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788201231.573323:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b0000030400/0x72011f792b786a4d lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72011f792b786a54 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.573330:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201231.573356:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0000030400/0x72011f792b786a4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72011f792b786a54 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201231.573374:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622496768:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201231.573401:0:13064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201231.573412:0:13064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0000030400/0x72011f792b786a4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72011f792b786a54 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201231.573437:0:13064:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788201231.573447:0:13064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0400/0x72011f792b786d41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786d48 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.573455:0:13064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0400/0x72011f792b786d41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786d48 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.573462:0:13064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0400/0x72011f792b786d41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786d48 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.573469:0:13064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0400/0x72011f792b786d41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786d48 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.573486:0:13064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201231.573492:0:13064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00029c6e00/0x72011f792b786801 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786808 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.573509:0:13064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00029c6e00/0x72011f792b786801 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786808 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.573516:0:13064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00029c6e00/0x72011f792b786801 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786808 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.573523:0:13064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff9b00029c6e00/0x72011f792b786801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786808 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.573536:0:13064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788201231.573539:0:13064:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788201231.573542:0:13064:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788201231.573584:0:13064:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788201231.573589:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788201231.573594:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201231.573602:0:13064:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1788201231.573609:0:13064:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9b0035c08000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201231.573615:0:13064:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9b003f5e6800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201231.573622:0:13064:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9b003f3c1000 5e1fa00b-ddbb-4133-8a19-496b22d710da 192.168.203.14@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201231.573626:0:13064:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9b003f8ef000 aa6eef1a-3f03-469a-ac4c-2a406b6709bc 192.168.203.14@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967521 stale:0 00000020:00080000:0.0:1788201231.573632:0:13064:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9b00070199c0) has exports, disconnecting them 00000020:00080000:0.0:1788201231.573636:0:13064:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b0035c08000), last request at 1788201231 00000020:00000080:0.0:1788201231.573645:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786a15 00000100:00080000:0.0:1788201231.573666:0:13064:0:(import.c:65:import_set_state_nolock()) ffff9b0035c0a800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788201231.573716:0:13064:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b0035c08000): rc 0 00000020:00000080:0.0:1788201231.573719:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b0035c08000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788201231.573729:0:13064:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b003f5e6800), last request at 1788201231 00000020:00000080:0.0:1788201231.573732:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b78694a 00000100:00080000:0.0:1788201231.573738:0:13064:0:(import.c:65:import_set_state_nolock()) ffff9b003f5e3800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788201231.573744:0:13064:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b003f5e6800): rc 0 00000020:00000080:0.0:1788201231.573746:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b003f5e6800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788201231.573759:0:13064:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb3aec3d2bae0 00000100:00080000:0.0:1788201231.573784:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788201231.573787:0:13064:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788201231.573812:0:13064:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788201231.573873:0:13064:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788201231.573888:0:13064:0:(import.c:65:import_set_state_nolock()) ffff9b0040946800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788201231.573901:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788201231.573903:0:13064:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788201231.573913:0:13064:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788201231.573990:0:13064:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788201231.574256:0:13064:0:(import.c:65:import_set_state_nolock()) ffff9b003f5e4800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788201231.574303:0:13064:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9b00070199c0) has no exports 00010000:00010000:0.0:1788201231.575356:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201231.575371:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0400/0x72011f792b786d41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786d48 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201231.575377:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201231.575384:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0400 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1788201231.575389:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0400/0x72011f792b786d41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786d48 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.575401:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0400/0x72011f792b786d41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72011f792b786d48 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201231.575409:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0400/0x72011f792b786d41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72011f792b786d48 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201231.575416:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788201231.575419:0:5816:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788201231.575423:0:5816:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788201231.575464:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0400/0x72011f792b786d41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x72011f792b786d48 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.575471:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201231.575496:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0400/0x72011f792b786d41 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x72011f792b786d48 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.575515:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b001f8f0400/0x72011f792b786d41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x72011f792b786d48 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201231.575620:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622496896:0@lo:9:umount.0 00000100:00100000:3.0:1788201231.575688:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201231.575714:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622497024:0@lo:9:umount.0 00000100:00100000:3.0:1788201231.575738:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201231.575774:0:12066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622496896 00000100:00100000:3.0:1788201231.575782:0:12066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622496896 00000100:00100000:3.0:1788201231.575831:0:12066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622497024 00000100:00100000:3.0:1788201231.575834:0:12066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622497024 00000100:00100000:3.0:1788201231.575866:0:12066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788201231.575876:0:12066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3291:x1875064622496896:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788201231.575908:0:12066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786997 00000100:00080000:3.0:1788201231.575918:0:12066:0:(import.c:65:import_set_state_nolock()) ffff9b003f8ed800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788201231.576400:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788201231.576410:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875064622497024:12345-0@lo:9:umount.0 00000001:00000004:3.0:1788201231.576567:0:12066:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788201231.576804:0:12066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3291:x1875064622496896:12345-0@lo:9:umount.0 Request processed in 929us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.576813:0:12066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788201231.576872:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b0040946800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788201231.576890:0:3291:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788201231.576892:0:3291:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201231.576896:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622496896:0@lo:9:umount.0 00000020:00000080:2.0:1788201231.577022:0:6677:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786a7e 00000100:00080000:2.0:1788201231.577032:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9b003f5e7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201231.577059:0:6677:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788201231.577880:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3291:x1875064622497024:12345-0@lo:9:umount.0 Request processed in 1466us (2134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.577892:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788201231.578057:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622496768 00000100:00100000:3.0:1788201231.578065:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622496768 00000100:00100000:3.0:1788201231.578145:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201231.578157:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+17:3295:x1875064622496768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201231.578284:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201231.578312:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0000030c00/0x72011f792b786a54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72011f792b786a4d expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.578359:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201231.578401:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+16:3295:x1875064622496768:12345-0@lo:103:ldlm_bl.0 Request processed in 247us (3028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.578409:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788201231.578590:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b003f5e4800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788201231.578615:0:3291:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788201231.578617:0:3291:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201231.578621:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622497024:0@lo:9:umount.0 00000100:00100000:3.0:1788201231.579033:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16f590af-689d-4459-b486-809c9db65822:3295:1875064622496768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201231.579297:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622497152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201231.579350:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201231.580816:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622497152 00000100:00100000:2.0:1788201231.580830:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622497152 00000100:00100000:2.0:1788201231.580905:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788201231.580916:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+16:3292:x1875064622497152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201231.581323:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201231.581348:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b00029c6e00/0x72011f792b786801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786808 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.581361:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6e00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1788201231.581367:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b00029c6e00/0x72011f792b786801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786808 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.581378:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b00029c6e00/0x72011f792b786801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x72011f792b786808 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201231.581387:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b00029c6e00/0x72011f792b786801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x72011f792b786808 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201231.581395:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201231.581398:0:5816:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788201231.581403:0:5816:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788201231.581444:0:5816:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b00029c6e00/0x72011f792b786801 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72011f792b786808 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.581451:0:5816:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201231.581480:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b00029c6e00/0x72011f792b786801 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72011f792b786808 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.581487:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b00029c6e00/0x72011f792b786801 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72011f792b786808 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201231.581494:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788201231.581517:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201231.581519:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201231.581521:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201231.581523:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622497280:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1788201231.581553:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0035c08000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1788201231.581598:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788201231.581628:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b003f5e6800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1788201231.581655:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622497280 00000100:00100000:3.0:1788201231.581660:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622497280 00000020:00000080:0.0:1788201231.581669:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b0035c0a800 for lustre-MDT0000 00000020:00000080:0.0:1788201231.581673:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b003f5e3800 for lustre-MDT0000 00010000:00010000:0.0:1788201231.581683:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201231.581690:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201231.581691:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788201231.581697:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+17:3292:x1875064622497280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201231.581698:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201231.581701:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201231.581703:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201231.581710:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201231.581726:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00126fc800/0x72011f792b786808 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72011f792b786801 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.581741:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201231.581777:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16f590af-689d-4459-b486-809c9db65822+16:3292:x1875064622497280:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.581784:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788201231.581839:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622497280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201231.582158:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201231.582240:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00126fde00/0x72011f792b786d48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72011f792b786d41 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201231.582266:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201231.582305:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16f590af-689d-4459-b486-809c9db65822+14:3292:x1875064622497152:12345-0@lo:103:ldlm_bl.0 Request processed in 1391us (2954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.582312:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201231.583313:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16f590af-689d-4459-b486-809c9db65822:3292:1875064622497152:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788201231.594351:0:13064:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9b00070199c0) has no exports 00000020:00000080:0.0:1788201231.672938:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b78685c 00000020:00000080:0.0:1788201231.672961:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b0026fed800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788201231.673056:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788201231.673232:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0026fed800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788201231.673804:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201231.673820:0:13064:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788201231.673825:0:13064:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9b000569b380) has no exports 00000020:00000080:2.0:1788201231.674183:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786855 00000020:00000080:2.0:1788201231.674193:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b003bdfc800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201231.674253:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201231.674264:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788201231.674268:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b0002f06000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788201231.674271:0:13064:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0002f06000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788201231.674278:0:13064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788201231.674522:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b003bdfc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788201231.823599:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788201232.195789:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:1.0:1788201232.195828:0:5849:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5e1fa00b-ddbb-4133-8a19-496b22d710da 00000001:00080000:1.0:1788201232.195836:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1788201232.195840:0:5849:0:(genops.c:906:class_export_put()) final put ffff9b003f3c1000/5e1fa00b-ddbb-4133-8a19-496b22d710da 00000001:00100000:1.0:1788201232.195857:0:5849:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aa6eef1a-3f03-469a-ac4c-2a406b6709bc 00000001:00080000:1.0:1788201232.195873:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788201232.195889:0:5849:0:(genops.c:906:class_export_put()) final put ffff9b003f8ef000/aa6eef1a-3f03-469a-ac4c-2a406b6709bc 00000020:00000080:1.0:1788201232.195904:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b003f3c1000/5e1fa00b-ddbb-4133-8a19-496b22d710da for lustre-MDT0000 00000020:00000080:1.0:1788201232.195957:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b003f8ef000/aa6eef1a-3f03-469a-ac4c-2a406b6709bc for lustre-MDT0000 00000020:00000080:1.0:1788201232.195994:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b003f3c6000 for lustre-MDT0000 00000020:00000080:1.0:1788201232.195998:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b003f8ee000 for lustre-MDT0000 00000001:00100000:1.0:1788201232.201530:0:6702:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa6eef1a-3f03-469a-ac4c-2a406b6709bc 00000020:00000080:1.0:1788201232.201544:0:6702:0:(genops.c:906:class_export_put()) final put ffff9b0003202800/aa6eef1a-3f03-469a-ac4c-2a406b6709bc 00000001:00100000:1.0:1788201232.201587:0:6702:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201232.201590:0:6702:0:(genops.c:906:class_export_put()) final put ffff9b003f8ec800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201232.201651:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0003202800/aa6eef1a-3f03-469a-ac4c-2a406b6709bc for lustre-OST0000 00000020:00000080:2.0:1788201232.201716:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b003f8ec800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788201232.201742:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b0003201000 for lustre-OST0000 00000020:00000080:2.0:1788201232.201747:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b003f8ed800 for lustre-OST0000 00010000:00010000:0.0:1788201232.843814:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788201233.675409:0:13064:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b0007d68300 - data ffff9b003ff7e438/ffff9b003b2c7c00 00000020:01000000:2.0:1788201233.675584:0:13064:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b00070da480 - data ffff9b001cc11bd0/ffff9b003a2fb400 00000001:00000004:1.0:1788201233.699391:0:13064:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000001:00100000:3.0:1788201233.738589:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201233.738603:0:7643:0:(genops.c:906:class_export_put()) final put ffff9b003f5e2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201233.738701:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b003f5e2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788201233.738770:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b003f5e7000 for lustre-OST0001 00000100:00080000:2.0:1788201233.803898:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788201233.803906:0:13064:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788201233.803936:0:13064:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201233.803938:0:13064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788201233.807000:0:7208:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788201233.807013:0:7208:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1788201233.807035:0:7208:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788201233.808979:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788201233.808987:0:13064:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788201233.809010:0:13064:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201233.809024:0:13064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788201233.809655:0:7763:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788201233.809660:0:7763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788201233.809679:0:7763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788201233.883825:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786824 00000020:00000080:1.0:1788201233.883842:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b0026f91800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788201233.891268:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786839 00000020:00000080:1.0:1788201233.891291:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b0040946000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201233.893604:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0026f91800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788201233.894229:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788201233.894246:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201233.894257:0:13064:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201233.894263:0:13064:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9b000701b380) has no exports 00000004:01000000:1.0:1788201233.894505:0:13064:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788201233.894519:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786a77 00000020:00000080:1.0:1788201233.894530:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b0035c0a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201233.894537:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788201233.894541:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201233.894547:0:13064:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201233.894549:0:13064:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9b00067e3380) has no exports 00000020:00000080:1.0:1788201233.894557:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786a70 00000020:00000080:1.0:1788201233.894561:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b0035c0f000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788201233.894986:0:13064:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788201233.894992:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201233.894998:0:13064:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788201233.895005:0:13064:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201233.895007:0:13064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201233.895043:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201233.895050:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201233.895055:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786990 00000020:00000080:1.0:1788201233.895061:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b001f90d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201233.895064:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788201233.895068:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201233.895072:0:13064:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201233.895074:0:13064:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9b0005698000) has no exports 00000020:00000080:1.0:1788201233.895079:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786989 00000020:00000080:1.0:1788201233.895094:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b0040945000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788201233.895519:0:13064:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788201233.895523:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201233.895526:0:13064:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1788201233.895530:0:13064:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201233.895532:0:13064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201233.895558:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201233.895564:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201233.895596:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201233.895599:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201233.895631:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786840 00000020:00000080:1.0:1788201233.895637:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b0040941000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788201233.895642:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788201233.895646:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201233.895649:0:13064:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201233.895652:0:13064:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9b004093cd40) has no exports 00000020:00000080:1.0:1788201233.895673:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201233.895676:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788201233.895679:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786847 00000020:00000080:1.0:1788201233.895682:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b0040947000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788201233.895695:0:13064:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b0007c1d000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788201233.895699:0:13064:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b0007c1d000 3 00000020:01000004:1.0:1788201233.895703:0:13064:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b0007c1d000 from lustre-MDT0000 00000020:00000080:1.0:1788201233.895724:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201233.895728:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788201233.895731:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b0026f90800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788201233.895734:0:13064:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0026f90800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788201233.895745:0:13064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788201233.895828:0:13064:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788201233.895832:0:13064:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788201233.895835:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788201233.895838:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201233.895841:0:13064:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788201233.895856:0:13064:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9b00050a6000 16f590af-689d-4459-b486-809c9db65822 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201233.895862:0:13064:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9b000569cd40) has exports, disconnecting them 00000020:00080000:1.0:1788201233.895867:0:13064:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9b00050a6000), last request at 1788201023 00000020:00000080:1.0:1788201233.895886:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b7867e5 00000020:00010000:1.0:1788201233.895890:0:13064:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b00050a6000: total 7 00000100:00080000:1.0:1788201233.895895:0:13064:0:(import.c:65:import_set_state_nolock()) ffff9b00050a4000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201233.895914:0:13064:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b00050a6000): rc 0 00000020:00080000:1.0:1788201233.895918:0:13064:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9b000569cd40) has no exports 00000100:00100000:1.0:1788201233.896006:0:5821:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9b0002b4f000:5821] 1 exiting: rc = 0 00000020:00010000:0.0:1788201233.896316:0:8450:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b00050a6000: total 7 00010000:00010000:0.0:1788201233.896355:0:8450:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b00050a6000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788201233.896390:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0000031c00/0x72011f792b7868fd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72011f792b7868f6 expref: 9 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201233.896414:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b004217ca00/0x72011f792b786b49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72011f792b786b42 expref: 8 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201233.896428:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b00126fca00/0x72011f792b786af5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72011f792b786aee expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201233.896460:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b004217d800/0x72011f792b786b03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72011f792b786afc expref: 6 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201233.896472:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0001680a00/0x72011f792b786b11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72011f792b786b0a expref: 5 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201233.896498:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0001681000/0x72011f792b786d2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72011f792b786d25 expref: 4 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201233.896509:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b001f8f0a00/0x72011f792b786d3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72011f792b786d33 expref: 3 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201233.896523:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b004217d400/0x72011f792b786b1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72011f792b786b18 expref: 2 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201233.896534:0:8450:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b00050a6000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788201233.896549:0:8450:0:(genops.c:906:class_export_put()) final put ffff9b00050a6000/16f590af-689d-4459-b486-809c9db65822 00010000:00010000:0.0:1788201233.896559:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201233.896561:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201233.896563:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201233.896967:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0040946000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788201233.896976:0:8:0:(genops.c:906:class_export_put()) final put ffff9b0026f95800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201233.896978:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0026f95800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788201233.896985:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201233.897170:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0035c0a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788201233.897176:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0035c0f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201233.897182:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b003f5e4800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788201233.897187:0:8:0:(genops.c:906:class_export_put()) final put ffff9b0035c08800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201233.897189:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0035c08800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788201233.897193:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201233.897223:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b001f90d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788201233.897229:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0040945000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201233.897241:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b0040946800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788201233.897246:0:8:0:(genops.c:906:class_export_put()) final put ffff9b003f8f0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201233.897249:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b003f8f0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788201233.897256:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201233.897335:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0040941000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788201233.897339:0:8:0:(genops.c:906:class_export_put()) final put ffff9b0026f91000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788201233.897341:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0026f91000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788201233.897345:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788201233.897532:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0040947000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201233.897537:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b00050a6000/16f590af-689d-4459-b486-809c9db65822 for MGS 00000020:00000080:2.0:1788201233.897576:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b00050a4000 for MGS 00000100:00100000:3.0:1788201233.897717:0:5819:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9b0002b4e600:5819] 0 exiting: rc = 1 00000100:00100000:3.0:1788201233.897822:0:5822:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9b0033151e00:5822] 2 exiting: rc = 0 00000100:00100000:1.0:1788201233.898312:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898322:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898330:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898338:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898345:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898351:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898358:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898364:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898371:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898378:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898383:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898389:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898395:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898401:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898407:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898413:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898421:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898428:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898434:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898440:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898454:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898460:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898466:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898473:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.898954:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900250:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900258:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900266:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900272:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900278:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900285:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900290:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900296:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900301:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900307:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900314:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900320:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900325:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900331:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900338:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900344:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900349:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900354:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900359:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900365:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900371:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900376:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900381:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900387:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900392:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900397:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900402:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900407:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900412:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900417:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900421:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900427:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900432:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900439:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900465:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900472:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900478:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900498:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201233.900504:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788201233.902350:0:13064:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788201233.902358:0:13064:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788201233.910035:0:13064:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b0005d96720 - data ffff9b003fec1a20/ffff9b0040580800 00000020:01000000:1.0:1788201233.910222:0:13064:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b0007c55060 - data ffff9b001d75de58/ffff9b0005140400 00000020:00000080:0.0:1788201233.910833:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b7867c9 00000020:00000080:0.0:1788201233.910844:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b0008052800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788201233.910867:0:13064:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b0007c1d000 from MGS, refs=2 00000020:01000004:0.0:1788201233.910872:0:13064:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b0007c1d000 2 00000020:01000004:0.0:1788201233.910875:0:13064:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b0007c1d000 from MGS 00000020:00000080:0.0:1788201233.910903:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201233.910912:0:13064:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788201233.910914:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b0008051800/MGS 00000020:00000080:0.0:1788201233.910917:0:13064:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0008051800/MGS for MGS 00000020:01000000:0.0:1788201233.910925:0:13064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788201233.911015:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788201233.911016:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0008052800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201233.911019:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201233.911026:0:13064:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788201233.911035:0:13064:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9b0026f59000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201233.911043:0:13064:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9b0010a499c0) has exports, disconnecting them 00000020:00080000:0.0:1788201233.911049:0:13064:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9b0026f59000), last request at 1788201024 00000020:00000080:0.0:1788201233.911055:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786894 00000020:00080000:0.0:1788201233.911070:0:13064:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b0026f59000): rc 0 00000020:00000080:0.0:1788201233.911075:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b0026f59000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788201233.911104:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0026f59000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788201233.914246:0:13064:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788201233.914258:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201233.914263:0:13064:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788201233.914273:0:13064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201233.915015:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201233.915027:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788201233.915037:0:13064:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b0007c1d000 1 00000020:00000080:1.0:1788201233.915045:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b7867bb 00000020:00000080:1.0:1788201233.915056:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b0008057800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201233.919933:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b0026f5f000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788201233.920086:0:38:0:(genops.c:906:class_export_put()) final put ffff9b0026f58800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788201233.920114:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0026f58800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788201233.920126:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:1.0:1788201233.920502:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788201233.920512:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201233.920523:0:13064:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201233.920529:0:13064:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9b0007018000) has no exports 00000020:00000080:2.0:1788201233.922013:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0008057800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788201234.032605:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201234.032626:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788201234.032634:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b000a695800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788201234.032639:0:13064:0:(genops.c:865:class_export_destroy()) destroying export ffff9b000a695800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788201234.032655:0:13064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788201234.032794:0:13064:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b000a693000 00000020:01000000:1.0:1788201234.032823:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788201234.032841:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201234.032847:0:13064:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788201234.032852:0:13064:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9b000514cd40) has no exports 00000100:00100000:2.0:1788201234.037798:0:5828:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9b0010cc4c00:5828] 1 exiting: rc = 0 00000100:00100000:3.0:1788201234.040025:0:9471:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9b0035a62800:9471] 3 exiting: rc = 0 00000100:00100000:3.0:1788201234.040240:0:5829:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9b0005723200:5829] 2 exiting: rc = 0 00000100:00100000:3.0:1788201234.040336:0:5827:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9b0010cc5c00:5827] 0 exiting: rc = 1 00000100:00100000:1.0:1788201234.044390:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044407:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044413:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044420:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044428:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044434:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044440:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044446:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044453:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044459:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044464:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044470:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044476:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044493:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044499:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044506:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044511:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044518:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044525:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044530:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044536:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044541:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044548:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044553:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044559:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044564:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044570:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044577:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044583:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044588:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044594:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044600:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044626:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044633:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044639:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044646:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044653:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044659:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044665:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044672:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044680:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044685:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044692:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044698:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044704:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044710:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044736:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044742:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044748:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044754:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044761:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044767:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044773:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044779:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044785:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044791:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044797:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044802:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044809:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044815:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044821:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044827:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044833:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.044850:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201234.063707:0:5831:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9b000f3f5600:5831] 1 exiting: rc = 0 00000100:00100000:2.0:1788201234.063806:0:5830:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9b000f3f4200:5830] 0 exiting: rc = 1 00000100:00100000:0.0:1788201234.069837:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.069857:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.069870:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.069880:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.069887:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.069904:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.069911:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.069925:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.069931:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.069939:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.069947:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.069955:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.069964:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.069971:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.069979:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.069986:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.069995:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070001:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070006:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070012:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070018:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070025:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070032:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070038:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070062:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070068:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070075:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070081:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070089:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070097:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070105:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070111:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070116:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070121:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070127:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070148:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070156:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070161:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070167:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070173:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070178:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070183:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070188:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070194:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070200:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070205:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070211:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070217:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070223:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070229:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070235:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070240:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070246:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070252:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070258:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070264:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070270:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070275:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070282:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070295:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070302:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070308:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070314:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.070321:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.075711:0:5833:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9b00050bee00:5833] 1 exiting: rc = 0 00000100:00100000:1.0:1788201234.075937:0:12067:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9b001f800800:12067] 2 exiting: rc = 0 00000100:00100000:1.0:1788201234.080668:0:5832:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9b00050be000:5832] 0 exiting: rc = 1 00000100:00100000:2.0:1788201234.080814:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.080844:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.080853:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.080863:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.080870:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.080882:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.080947:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.084835:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.084878:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.084887:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.084928:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.084936:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.084943:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.084950:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.084972:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.084983:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.084995:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085003:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085011:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085019:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085026:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085033:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085059:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085066:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085073:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085080:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085088:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085116:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085247:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085257:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085268:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085275:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085283:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085290:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085314:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085323:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085331:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085338:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085344:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085351:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085358:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085365:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085372:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085379:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085386:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085392:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085414:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085423:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085430:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085438:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085446:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085452:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085459:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085465:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085473:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085480:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085499:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085506:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085528:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085536:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085543:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085551:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085564:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201234.085572:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.108056:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9b00044bca00:5834] 0 exiting: rc = 1 00000100:00100000:2.0:1788201234.108445:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9b0005080a00:5835] 1 exiting: rc = 0 00000100:00100000:0.0:1788201234.108545:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.108556:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.108563:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.108570:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.108579:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.108586:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.108595:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.108602:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.108610:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.108617:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.108625:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.108632:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.108639:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.108648:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109063:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109069:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109074:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109079:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109084:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109089:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109094:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109099:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109199:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109211:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109218:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109224:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109230:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109236:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109243:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109250:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109268:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109273:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109278:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109284:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109290:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109295:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109300:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109306:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109312:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109318:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109878:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109888:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109896:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109903:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109910:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109918:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109925:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109931:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109938:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109945:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109953:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109959:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109965:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109970:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.109975:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.110419:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.110432:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.110440:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.110449:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.110457:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.110467:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.110475:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.110494:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.110502:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.112640:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9b00050db800:5837] 1 exiting: rc = 0 00000100:00100000:2.0:1788201234.113990:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9b00050dac00:5836] 0 exiting: rc = 1 00000100:00100000:1.0:1788201234.114167:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114177:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114183:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114189:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114194:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114200:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114206:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114213:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114221:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114229:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114235:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114241:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114247:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114252:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114258:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114263:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114268:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114274:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114279:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114283:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114288:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114293:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114298:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114303:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114308:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114313:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114318:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114322:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114327:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114333:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114338:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114343:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114348:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114353:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114359:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114379:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114384:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114389:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114395:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114400:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114405:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114410:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114415:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114420:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114426:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114431:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114437:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114443:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114448:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114454:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114460:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114465:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114471:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114476:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114492:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114499:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114504:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114510:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114516:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114522:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114527:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114532:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114538:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.114544:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.115162:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9b00050da600:5838] 0 exiting: rc = 1 00000100:00100000:2.0:1788201234.115213:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9b00050ff000:5839] 1 exiting: rc = 0 00000100:00100000:1.0:1788201234.115414:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115424:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115429:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115435:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115440:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115446:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115464:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115470:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115476:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115494:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115500:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115505:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115511:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115516:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115522:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115528:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115535:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115542:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115549:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115554:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115560:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115566:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115571:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115577:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115583:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115589:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115596:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115601:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115606:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115611:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115616:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115621:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115626:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115631:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115636:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115641:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115646:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115650:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115655:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115661:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115665:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115680:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115685:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115691:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115695:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115700:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115705:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115709:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115715:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115719:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115724:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115729:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115734:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115738:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115743:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115747:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115752:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115757:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115763:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115769:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115774:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115779:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115784:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201234.115789:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.121290:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9b00050fec00:5840] 0 exiting: rc = 1 00000100:00100000:2.0:1788201234.123078:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9b00050ff800:5841] 1 exiting: rc = 0 00000100:00100000:1.0:1788201234.123653:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9b00050fe000:5842] 2 exiting: rc = 0 00000100:00100000:0.0:1788201234.123769:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123780:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123799:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123808:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123816:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123825:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123834:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123841:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123850:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123858:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123867:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123877:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123885:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123894:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123903:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123945:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123955:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123961:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123967:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123973:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.123979:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124150:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124157:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124163:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124168:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124173:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124179:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124184:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124190:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124197:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124205:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124211:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124216:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124243:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124249:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124256:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124264:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124270:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124277:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124300:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124310:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124318:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124456:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124466:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124473:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124479:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124497:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124506:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124514:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124522:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124531:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124539:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124550:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124559:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124568:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124577:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124585:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124593:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124602:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124610:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124617:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124625:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124632:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201234.124640:0:13064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788201234.142942:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201234.142966:0:13064:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788201234.142973:0:13064:0:(genops.c:906:class_export_put()) final put ffff9b00050c3000/MDS_uuid 00000020:00000080:1.0:1788201234.142979:0:13064:0:(genops.c:865:class_export_destroy()) destroying export ffff9b00050c3000/MDS_uuid for MDS 00000020:01000000:1.0:1788201234.143048:0:13064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788201234.143405:0:13064:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788201234.352755:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201235.403525:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201236.237062:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622497408:0@lo:400:kworker.0 00000400:00000100:2.0:1788201236.237116:0:3294:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064622497408 offset 0 length 224: 4 00000100:00100000:3.0:1788201236.241438:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201236.241459:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622497536:0@lo:400:kworker.0 00000400:00000100:3.0:1788201236.241523:0:3294:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064622497536 offset 0 length 224: 4 00000100:00100000:2.0:1788201236.242395:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201236.242409:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622497664:0@lo:400:kworker.0 00000400:00000100:2.0:1788201236.242442:0:3293:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064622497664 offset 0 length 224: 4 00010000:00010000:0.0:1788201236.429650:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788201236.878472:0:13218:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788201236.910563:0:13218:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788201236.910619:0:13218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b004217ce00/0x72011f792b786b0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b11 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201236.910662:0:13218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b004217ce00/0x72011f792b786b0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786b11 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201236.910671:0:13218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b004217ce00/0x72011f792b786b0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786b11 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201236.910679:0:13218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff9b004217ce00/0x72011f792b786b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786b11 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201236.910797:0:13218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788201236.910803:0:13218:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1788201236.910804:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201236.910810:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b004217ce00/0x72011f792b786b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786b11 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788201236.910825:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201236.910836:0:13218:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b002722e680 x1875064622497536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201252 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201236.910857:0:13218:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788201236.910863:0:13218:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788201236.910885:0:13218:0:(import.c:65:import_set_state_nolock()) ffff9b003f8f4800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788201236.910928:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622497536:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.911000:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1875064622497792:0@lo:39:umount.0 00000400:00000100:2.0:1788201236.911050:0:3291:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064622497792 offset 0 length 224: 4 00010000:00010000:0.0:1788201236.911128:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b004217ce00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1788201236.911215:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b004217ce00/0x72011f792b786b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786b11 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201236.911226:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b004217ce00/0x72011f792b786b0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x72011f792b786b11 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201236.911233:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b004217ce00/0x72011f792b786b0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x72011f792b786b11 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201236.911239:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201236.911242:0:8450:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788201236.911244:0:8450:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788201236.911445:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b004217ce00/0x72011f792b786b0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x72011f792b786b11 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201236.911453:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201236.911508:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622497920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201236.911551:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201236.911614:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622497920 00000100:00100000:3.0:1788201236.911621:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622497920 00000100:00100000:3.0:1788201236.911670:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788201236.911678:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3293:x1875064622497920:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788201236.911684:0:5813:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788201236 with bad export cookie 8214881800581310437 00010000:00010000:0.0:1788201236.915568:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b004217ce00/0x72011f792b786b0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x72011f792b786b11 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201236.915585:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b004217ce00/0x72011f792b786b0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x72011f792b786b11 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201236.915606:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201236.915608:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201236.915611:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201236.921117:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3293:x1875064622497920:12345-0@lo:103:ldlm_bl.0 Request processed in 9431us (9559us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201236.921158:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788201236.921267:0:3293:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.114@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788201236.921272:0:3293:0:(import.c:65:import_set_state_nolock()) ffff9b0005cc6000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788201236.921275:0:3293:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.114@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788201236.929529:0:3293:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.114@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788201236.929535:0:3293:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788201236.929545:0:3293:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b002722d180 x1875064622497408/t0(0) o400->MGC192.168.203.114@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201252 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201236.929615:0:3293:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b0035f86a00 x1875064622497920/t0(0) o103->MGC192.168.203.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201252 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788201236.929625:0:3293:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788201236.929627:0:3293:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788201236.929629:0:3293:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788201236.929632:0:3293:0:(import.c:65:import_set_state_nolock()) ffff9b0005cc6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201236.929637:0:3293:0:(import.c:510:import_select_connection()) MGC192.168.203.114@tcp: connect to NID 0@lo last attempt 103 00000100:00080000:0.0:1788201236.929645:0:3293:0:(import.c:624:import_select_connection()) MGC192.168.203.114@tcp: import ffff9b0005cc6000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788201236.929763:0:3293:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b002722ce00 x1875064622498048/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201236.929805:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16f590af-689d-4459-b486-809c9db65822:3293:1875064622497920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201236.929931:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:16f590af-689d-4459-b486-809c9db65822:3291:1875064622498048:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1788201236.929977:0:3291:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064622498048 offset 0 length 520: 4 00000100:00100000:3.0:1788201236.932014:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16f590af-689d-4459-b486-809c9db65822:3294:1875064622497408:0@lo:400:kworker.0 00010000:00010000:1.0:1788201237.452295:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201238.475382:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201239.500231:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201240.523571:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201241.355471:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 16f590af-689d-4459-b486-809c9db65822->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201241.355480:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 16f590af-689d-4459-b486-809c9db65822->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788201241.355571:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201241.363967:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622498176:0@lo:400:kworker.0 00000400:00000100:1.0:1788201241.364034:0:3295:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064622498176 offset 0 length 224: 4 00010000:00010000:1.0:1788201241.550446:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201242.380930:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 16f590af-689d-4459-b486-809c9db65822->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201242.380940:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 16f590af-689d-4459-b486-809c9db65822->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788201242.381017:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622498304:0@lo:400:kworker.0 00000400:00000100:0.0:1788201242.381072:0:3295:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064622498304 offset 0 length 224: 4 00010000:00010000:0.0:1788201242.571461:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201243.595432:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201244.620389:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201245.644312:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201246.475273:0:3291:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201236/real 1788201236] req@ffff9b002722ce00 x1875064622498048/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201246 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201246.475305:0:3291:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b002722ce00 x1875064622498048/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201246 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201246.475329:0:3291:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201236/real 1788201236] req@ffff9b002722ed80 x1875064622497792/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201246 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201246.475343:0:3291:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b002722ed80 x1875064622497792/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201246 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201246.475373:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b0005cc6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201246.475383:0:3291:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788201246.475386:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:16f590af-689d-4459-b486-809c9db65822:3291:1875064622498048:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:2.0:1788201246.475626:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 16f590af-689d-4459-b486-809c9db65822->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201246.475631:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201246.475634:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b0005cc6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201246.475639:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.114@tcp: connect to NID 0@lo last attempt 316 00000100:00080000:2.0:1788201246.475644:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.114@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788201246.475650:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.114@tcp: import ffff9b0005cc6000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788201246.475803:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b003b0ad880 x1875064622498432/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201246.475910:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201246.475922:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622498560:0@lo:400:kworker.0 00000400:00000100:2.0:1788201246.475981:0:3293:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064622498560 offset 0 length 224: 4 00000100:00080000:3.0:1788201246.485228:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b003f8f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788201246.485315:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1875064622497792:0@lo:39:umount.0 00000100:00100000:3.0:1788201246.485685:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:16f590af-689d-4459-b486-809c9db65822:3291:1875064622498432:0@lo:250:kworker.0 00000400:00000100:3.0:1788201246.485740:0:3291:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064622498432 offset 0 length 520: 4 00000100:00080000:2.0:1788201246.487860:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201246.487868:0:13218:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788201246.487876:0:13218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788201246.488888:0:13218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fd800/0x72011f792b786b18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b1f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.488905:0:13218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fd800/0x72011f792b786b18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786b1f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.488912:0:13218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fd800/0x72011f792b786b18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786b1f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.488920:0:13218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff9b00126fd800/0x72011f792b786b18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786b1f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.488940:0:13218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201246.488947:0:13218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681400/0x72011f792b786d33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786d3a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.488954:0:13218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681400/0x72011f792b786d33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786d3a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.488960:0:13218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681400/0x72011f792b786d33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786d3a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.488966:0:13218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff9b0001681400/0x72011f792b786d33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786d3a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.489005:0:13218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788201246.489010:0:13218:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788201246.489031:0:13218:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788201246.489036:0:13218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788201246.489041:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201246.489046:0:13218:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788201246.489051:0:13218:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9b0010a4cd40) has no exports 00000020:00080000:2.0:1788201246.489100:0:13218:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9b0010a4cd40) has no exports 00010000:00010000:0.0:1788201246.490606:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201246.490617:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b00126fd800/0x72011f792b786b18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786b1f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201246.490630:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fd800 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1788201246.490634:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b00126fd800/0x72011f792b786b18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786b1f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201246.490657:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b00126fd800/0x72011f792b786b18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x72011f792b786b1f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201246.490665:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b00126fd800/0x72011f792b786b18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x72011f792b786b1f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201246.490671:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201246.490673:0:5815:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788201246.490677:0:5815:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788201246.490693:0:5815:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b0005cc6000 00010000:00010000:0.0:1788201246.490697:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b00126fd800/0x72011f792b786b18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x72011f792b786b1f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201246.490704:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b00126fd800/0x72011f792b786b18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x72011f792b786b1f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201246.490720:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201246.490723:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0001681400/0x72011f792b786d33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786d3a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201246.490730:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681400 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1788201246.490733:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0001681400/0x72011f792b786d33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786d3a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201246.490739:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0001681400/0x72011f792b786d33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x72011f792b786d3a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201246.490747:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0001681400/0x72011f792b786d33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x72011f792b786d3a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201246.490770:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788201246.490772:0:5815:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788201246.490774:0:5815:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788201246.490781:0:5815:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b0005cc6000 00010000:00010000:0.0:1788201246.490784:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0001681400/0x72011f792b786d33 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x72011f792b786d3a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201246.490790:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0001681400/0x72011f792b786d33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x72011f792b786d3a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201246.490799:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201246.490801:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201246.490803:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788201246.490856:0:13218:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b0011d3bae0 - data ffff9b003fffd870/ffff9b00066aac00 00000020:01000000:2.0:1788201246.491003:0:13218:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b0033183120 - data ffff9b001d7a9288/ffff9b003f899400 00010000:00010000:3.0:1788201246.491638:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788201246.514003:0:13218:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788201246.555077:0:13218:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786919 00000020:00000080:1.0:1788201246.555087:0:13218:0:(genops.c:906:class_export_put()) final put ffff9b003f5e0800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788201246.555108:0:13218:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b0010346000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788201246.555111:0:13218:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b0010346000 2 00000020:01000004:1.0:1788201246.555114:0:13218:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b0010346000 from lustre-OST0000 00000020:00000080:1.0:1788201246.555161:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201246.555170:0:13218:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788201246.555173:0:13218:0:(genops.c:906:class_export_put()) final put ffff9b003f5e5000/lustre-OST0000_UUID 00000020:00000080:1.0:1788201246.555176:0:13218:0:(genops.c:865:class_export_destroy()) destroying export ffff9b003f5e5000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788201246.555182:0:13218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788201246.555223:0:13218:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788201246.555227:0:13218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788201246.555231:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201246.555236:0:13218:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788201246.555242:0:13218:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9b003f5e0000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201246.555249:0:13218:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9b00056999c0) has exports, disconnecting them 00000020:00080000:1.0:1788201246.555253:0:13218:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9b003f5e0000), last request at 1788201038 00000020:00000080:1.0:1788201246.555257:0:13218:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786943 00000020:00080000:1.0:1788201246.555279:0:13218:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b003f5e0000): rc 0 00000020:00000080:1.0:1788201246.555284:0:13218:0:(genops.c:906:class_export_put()) final put ffff9b003f5e0000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788201246.555854:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b003f5e0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788201246.555868:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b003f5e0000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788201246.563486:0:13218:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788201246.563495:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201246.563499:0:13218:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788201246.563508:0:13218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201246.563548:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b003f8f4800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788201246.563690:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201246.563699:0:13218:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788201246.563705:0:13218:0:(genops.c:906:class_export_put()) final put ffff9b00372b2000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788201246.563708:0:13218:0:(genops.c:865:class_export_destroy()) destroying export ffff9b00372b2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788201246.563714:0:13218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788201246.563770:0:13218:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b0010346000 1 00000020:00000080:0.0:1788201246.563775:0:13218:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b7868d3 00000020:00000080:0.0:1788201246.563782:0:13218:0:(genops.c:906:class_export_put()) final put ffff9b0040943800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788201246.563804:0:13218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788201246.563812:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0040943800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788201246.563821:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201246.563826:0:13218:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788201246.563830:0:13218:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9b0010a48000) has no exports 00000020:00000080:2.0:1788201246.581682:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201246.581698:0:13218:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788201246.581703:0:13218:0:(genops.c:906:class_export_put()) final put ffff9b0010341800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788201246.581708:0:13218:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0010341800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788201246.581715:0:13218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788201246.581851:0:13218:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b0010345000 00000020:02000400:2.0:1788201246.581895:0:13218:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788201246.809891:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201247.819803:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201248.843310:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788201249.205519:0:13370:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1788201249.215362:0:13370:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788201249.215463:0:13370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1e00/0x72011f792b786aee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786af5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.215480:0:13370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1e00/0x72011f792b786aee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786af5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.215488:0:13370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1e00/0x72011f792b786aee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786af5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.215494:0:13370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1e00/0x72011f792b786aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786af5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.215515:0:13370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788201249.215520:0:13370:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788201249.215540:0:13370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201249.215552:0:13370:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b002722d500 x1875064622497664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201252 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201249.215578:0:13370:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b004052dc00 x1875064622498176/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201257 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201249.215592:0:13370:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b0035f84e00 x1875064622498304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201258 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201249.215616:0:13370:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b003b0aea00 x1875064622498560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201262 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201249.215622:0:13370:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788201249.215651:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622498304:0@lo:400:kworker.0 00000100:00100000:0.0:1788201249.215662:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1875064622498176:0@lo:400:kworker.0 00000100:00080000:0.0:1788201249.215694:0:13370:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788201249.215718:0:13370:0:(import.c:65:import_set_state_nolock()) ffff9b004073d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788201249.215968:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622498560:0@lo:400:kworker.0 00000100:00100000:2.0:1788201249.215977:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622497664:0@lo:400:kworker.0 00010000:00010000:3.0:1788201249.216250:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201249.216258:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1e00/0x72011f792b786aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786af5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.216268:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1e00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1788201249.216272:0:5816:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1e00/0x72011f792b786aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786af5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.216281:0:5816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1e00/0x72011f792b786aee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72011f792b786af5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201249.216365:0:5816:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1e00/0x72011f792b786aee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72011f792b786af5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201249.216394:0:5816:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201249.216397:0:5816:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788201249.216399:0:5816:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788201249.216415:0:5816:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b0005cc6000 00010000:00010000:3.0:1788201249.216419:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1e00/0x72011f792b786aee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72011f792b786af5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.216426:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1e00/0x72011f792b786aee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72011f792b786af5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.216439:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201249.216441:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201249.216443:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201249.216459:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1875064622498688:0@lo:39:umount.0 00000400:00000100:3.0:1788201249.216504:0:3291:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064622498688 offset 0 length 224: 4 00010000:00010000:0.0:1788201249.867882:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201250.891410:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201251.598705:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 16f590af-689d-4459-b486-809c9db65822->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201251.598716:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 16f590af-689d-4459-b486-809c9db65822->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788201251.923557:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201252.939435:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201253.967459:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201254.987441:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201256.013360:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201256.715379:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 16f590af-689d-4459-b486-809c9db65822->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201256.715390:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 16f590af-689d-4459-b486-809c9db65822->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788201257.035805:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201258.060040:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201259.083787:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201259.467266:0:3291:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201249/real 1788201249] req@ffff9b0035f84e00 x1875064622498688/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201259 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201259.467299:0:3291:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b0035f84e00 x1875064622498688/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201259 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201259.467331:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b004073d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788201259.467355:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1875064622498688:0@lo:39:umount.0 00000100:00080000:0.0:1788201259.468405:0:13370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201259.468413:0:13370:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788201259.468419:0:13370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788201259.470039:0:13370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fc400/0x72011f792b786afc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786b03 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.470057:0:13370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fc400/0x72011f792b786afc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786b03 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.470077:0:13370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b00126fc400/0x72011f792b786afc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786b03 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.470084:0:13370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff9b00126fc400/0x72011f792b786afc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786b03 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.470213:0:13370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201259.470223:0:13370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1c00/0x72011f792b786d25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b786d2c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.470230:0:13370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1c00/0x72011f792b786d25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b786d2c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.470237:0:13370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1c00/0x72011f792b786d25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786d2c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.470243:0:13370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1c00/0x72011f792b786d25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72011f792b786d2c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.470333:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201259.470341:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b00126fc400/0x72011f792b786afc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786b03 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.470349:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00126fc400 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1788201259.470352:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b00126fc400/0x72011f792b786afc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786b03 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.470372:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b00126fc400/0x72011f792b786afc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x72011f792b786b03 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201259.470379:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b00126fc400/0x72011f792b786afc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x72011f792b786b03 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201259.470386:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201259.470393:0:5815:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1788201259.470404:0:5815:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b0005cc6000 00010000:00010000:2.0:1788201259.470408:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b00126fc400/0x72011f792b786afc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x72011f792b786b03 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.470409:0:13370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788201259.470414:0:13370:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788201259.470415:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b00126fc400/0x72011f792b786afc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x72011f792b786b03 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201259.470418:0:13370:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:2.0:1788201259.470429:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201259.470432:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1c00/0x72011f792b786d25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786d2c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788201259.470436:0:13370:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00010000:00010000:2.0:1788201259.470437:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1c00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1788201259.470440:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1c00/0x72011f792b786d25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72011f792b786d2c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1788201259.470441:0:13370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788201259.470445:0:13370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201259.470450:0:13370:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788201259.470453:0:13370:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9b0040938000) has no exports 00000020:00080000:0.0:1788201259.470475:0:13370:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9b0040938000) has no exports 00010000:00010000:3.0:1788201259.470535:0:5816:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201259.470566:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1c00/0x72011f792b786d25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x72011f792b786d2c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201259.470574:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1c00/0x72011f792b786d25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x72011f792b786d2c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201259.470590:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788201259.470592:0:5815:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788201259.470593:0:5815:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788201259.470599:0:5815:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b0005cc6000 00010000:00010000:2.0:1788201259.470602:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1c00/0x72011f792b786d25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x72011f792b786d2c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.470608:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1c00/0x72011f792b786d25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x72011f792b786d2c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.470620:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201259.470622:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201259.470623:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788201259.473019:0:13370:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b0007144de0 - data ffff9b003feccca8/ffff9b0027551000 00000020:01000000:0.0:1788201259.473267:0:13370:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9aff03392a20 - data ffff9b003febdbd0/ffff9b001f958000 00100000:10000000:0.0:1788201259.488123:0:13370:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788201259.522192:0:13370:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b7869e4 00000020:00000080:0.0:1788201259.522202:0:13370:0:(genops.c:906:class_export_put()) final put ffff9b001f80e800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788201259.522241:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b001f80e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000004:2.0:1788201259.522259:0:13370:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b003f8e9800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788201259.522263:0:13370:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b003f8e9800 2 00000020:01000004:2.0:1788201259.522266:0:13370:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b003f8e9800 from lustre-OST0001 00000020:00000080:2.0:1788201259.522292:0:13370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201259.522319:0:13370:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788201259.522323:0:13370:0:(genops.c:906:class_export_put()) final put ffff9b003a277800/lustre-OST0001_UUID 00000020:00000080:2.0:1788201259.522326:0:13370:0:(genops.c:865:class_export_destroy()) destroying export ffff9b003a277800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788201259.522332:0:13370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788201259.522638:0:13370:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 16f590af-689d-4459-b486-809c9db65822->MGS 00010000:00010000:2.0:1788201259.522654:0:13370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b00029c6400/0x72011f792b7868f6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72011f792b7868fd expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201259.522667:0:13370:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b00029c6400/0x72011f792b7868f6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72011f792b7868fd expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201259.522679:0:13370:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788201259.522693:0:13370:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788201259.522697:0:13370:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788201259.522711:0:13370:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b0005cc6000 00010000:00010000:2.0:1788201259.522715:0:13370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b00029c6400/0x72011f792b7868f6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72011f792b7868fd expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.522731:0:13370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72011f792b786b49 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201259.522738:0:13370:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72011f792b786b49 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201259.522743:0:13370:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201259.522745:0:13370:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788201259.523551:0:13370:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788201259.523569:0:13370:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b0005cc6000 00010000:00010000:2.0:1788201259.523574:0:13370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0001681200/0x72011f792b786b42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72011f792b786b49 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788201259.523600:0:13370:0:(import.c:65:import_set_state_nolock()) ffff9b0005cc6000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788201259.523604:0:13370:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788201259.523607:0:13370:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788201259.523608:0:13370:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788201259.523612:0:13370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788201259.523848:0:13370:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b003b0ad880 x1875064622498432/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788201261 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788201259.523869:0:13370:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788201259.523872:0:13370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:3.0:1788201259.524120:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:16f590af-689d-4459-b486-809c9db65822:3291:1875064622498432:0@lo:250:kworker.0 10000000:01000000:2.0:1788201259.524174:0:13370:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788201259.524182:0:13370:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b7867d7 00000020:00000080:2.0:1788201259.524189:0:13370:0:(genops.c:906:class_export_put()) final put ffff9b00050c2000/16f590af-689d-4459-b486-809c9db65822 00000020:01000000:2.0:1788201259.524209:0:13370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.114@tcp (flags='') 00000020:00000080:2.0:1788201259.524224:0:13370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201259.524231:0:13370:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.114@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788201259.524236:0:13370:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9b000701cd40) has no exports 00000020:00000080:3.0:1788201259.524273:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b00050c2000/16f590af-689d-4459-b486-809c9db65822 for MGC192.168.203.114@tcp 10000000:01000000:0.0:1788201259.524346:0:5825:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788201259.524543:0:13370:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.114@tcp: client import never connected 00000100:00080000:2.0:1788201259.524547:0:13370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788201259.524549:0:13370:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788201259.524551:0:13370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788201259.524554:0:13370:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788201259.524607:0:13370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201259.524614:0:13370:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.114@tcp (uuid 16f590af-689d-4459-b486-809c9db65822) 00000020:00000080:3.0:1788201259.524646:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b0005cc6000 for MGC192.168.203.114@tcp 00000020:00000080:3.0:1788201259.524659:0:38:0:(genops.c:906:class_export_put()) final put ffff9b0005cc1800/16f590af-689d-4459-b486-809c9db65822 00000020:00000080:3.0:1788201259.524661:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0005cc1800/16f590af-689d-4459-b486-809c9db65822 for MGC192.168.203.114@tcp 00000020:01000000:3.0:1788201259.524680:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.114@tcp (16f590af-689d-4459-b486-809c9db65822) 00000020:01000000:2.0:1788201259.524794:0:13370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788201259.524798:0:13370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201259.524803:0:13370:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788201259.524808:0:13370:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9b0035c0e800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201259.524813:0:13370:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9b0010a4b380) has exports, disconnecting them 00000020:00080000:2.0:1788201259.524817:0:13370:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9b0035c0e800), last request at 1788201054 00000020:00000080:2.0:1788201259.524821:0:13370:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b786a0e 00000020:00080000:2.0:1788201259.524832:0:13370:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b0035c0e800): rc 0 00000020:00000080:2.0:1788201259.524835:0:13370:0:(genops.c:906:class_export_put()) final put ffff9b0035c0e800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788201259.525041:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0035c0e800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788201259.528361:0:13370:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788201259.528370:0:13370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201259.528374:0:13370:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788201259.528380:0:13370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788201259.528530:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:0.0:1788201259.528695:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b004073d000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788201259.528811:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788201259.528904:0:5816:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1788201259.529027:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1788201259.529224:0:5810:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9b0008938200:5810] 0 exiting: rc = 1 00000100:00100000:3.0:1788201259.529274:0:5811:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9b0008939a00:5811] 1 exiting: rc = 0 00000100:00100000:0.0:1788201259.529348:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201259.529702:0:5812:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9b00118aec00:5812] 0 exiting: rc = 1 00000100:00100000:1.0:1788201259.529710:0:6691:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9b003f5c6a00:6691] 3 exiting: rc = 0 00000100:00100000:3.0:1788201259.529770:0:5813:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9b00118af200:5813] 1 exiting: rc = 0 00000100:00100000:3.0:1788201259.531323:0:5814:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9b00118f0600:5814] 2 exiting: rc = 0 00000100:00100000:0.0:1788201259.531504:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531513:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531519:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531524:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531536:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531542:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531548:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531554:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531559:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531564:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531570:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531576:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531581:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531586:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531591:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531596:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531601:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531607:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531612:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531634:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531640:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531645:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531650:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531655:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531660:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531679:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531684:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531698:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531705:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531709:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531714:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531720:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531725:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531730:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531736:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531741:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.531746:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532174:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532181:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532187:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532191:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532196:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532201:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532206:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532213:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532218:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532223:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532233:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532238:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532243:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532248:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532253:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532258:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532263:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532269:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532274:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532279:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532284:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532288:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532293:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532320:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532325:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532331:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.532346:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788201259.534299:0:13370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201259.534470:0:13370:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788201259.534477:0:13370:0:(genops.c:906:class_export_put()) final put ffff9b001f90b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788201259.534483:0:13370:0:(genops.c:865:class_export_destroy()) destroying export ffff9b001f90b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788201259.534489:0:13370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788201259.534537:0:13370:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b003f8e9800 1 00000020:00000080:0.0:1788201259.534543:0:13370:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x72011f792b7869b3 00000020:00000080:0.0:1788201259.534549:0:13370:0:(genops.c:906:class_export_put()) final put ffff9b00372b1000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788201259.534565:0:13370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788201259.534571:0:13370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201259.534576:0:13370:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788201259.534579:0:13370:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9b00409399c0) has no exports 00000020:00000080:3.0:1788201259.537860:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b00372b1000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788201259.584523:0:13370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201259.584537:0:13370:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788201259.584542:0:13370:0:(genops.c:906:class_export_put()) final put ffff9b003f8ea000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788201259.584546:0:13370:0:(genops.c:865:class_export_destroy()) destroying export ffff9b003f8ea000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788201259.584559:0:13370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788201259.584792:0:13370:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b003f8ee800 00000020:01000000:3.0:1788201259.584825:0:13370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788201259.584831:0:13370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201259.584836:0:13370:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788201259.584841:0:13370:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9b004093b380) has no exports 00000020:00000080:3.0:1788201259.585585:0:13370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201259.585595:0:13370:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788201259.585599:0:13370:0:(genops.c:906:class_export_put()) final put ffff9b0040940800/OSS_uuid 00000020:00000080:3.0:1788201259.585602:0:13370:0:(genops.c:865:class_export_destroy()) destroying export ffff9b0040940800/OSS_uuid for OSS 00000020:01000000:3.0:1788201259.585616:0:13370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788201259.585644:0:5823:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788201259.591769:0:12066:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9b001f801a00:12066] 4 exiting: rc = 0 00000100:00100000:2.0:1788201259.592266:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9b0007d18600:6678] 2 exiting: rc = 0 00000100:00100000:2.0:1788201259.592630:0:6675:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9b003b0b5400:6675] 0 exiting: rc = 1 00000100:00100000:0.0:1788201259.593901:0:7765:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9b003be0e600:7765] 3 exiting: rc = 0 00000100:00100000:3.0:1788201259.594600:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9b0007d19800:6677] 1 exiting: rc = 0 00000100:00100000:1.0:1788201259.596704:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596724:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596731:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596738:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596743:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596748:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596765:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596770:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596774:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596779:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596784:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596789:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596794:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596800:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596806:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596811:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596816:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596821:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596826:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596832:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596836:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596841:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596846:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596851:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596855:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596860:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596865:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596870:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596875:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596880:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596885:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596890:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596894:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596899:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596904:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596908:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596913:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596918:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596923:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596928:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596933:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596944:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596949:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596953:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596958:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596965:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596970:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596977:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596983:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596987:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.596993:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.597001:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.597006:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.597011:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.597016:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.597021:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.597026:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.597031:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.597035:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.597040:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.597045:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.597051:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.597056:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.597066:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201259.597862:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9b003b0b4800:6680] 1 exiting: rc = 0 00000100:00100000:3.0:1788201259.599487:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9b003b0b4a00:6679] 0 exiting: rc = 1 00000100:00100000:1.0:1788201259.599630:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599642:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599648:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599653:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599658:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599718:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599726:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599732:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599739:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599745:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599750:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599755:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599776:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599781:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599786:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599791:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599796:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599800:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599805:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599809:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599814:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599819:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599824:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599828:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599834:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599839:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599844:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599849:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599854:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599858:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599863:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599867:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599872:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599877:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599882:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599888:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599892:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599897:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599903:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599908:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599915:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599920:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599925:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599930:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599936:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599941:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599946:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599959:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599964:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599969:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599974:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599979:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599985:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599990:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.599995:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.600000:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.600007:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.600012:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.600018:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.600023:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.600029:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.600034:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.600039:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.600045:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201259.605077:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9b0005780000:6681] 0 exiting: rc = 1 00000100:00100000:2.0:1788201259.605334:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9b0007d18c00:6682] 1 exiting: rc = 0 00000100:00100000:0.0:1788201259.614013:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9b0040722000:6683] 2 exiting: rc = 0 00000100:00100000:1.0:1788201259.614258:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614267:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614273:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614279:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614285:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614324:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614332:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614339:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614344:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614350:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614356:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614362:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614368:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614374:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614379:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614385:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614390:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614395:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614417:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614422:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614427:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614433:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614440:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614447:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614453:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614457:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614982:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614992:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.614997:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615025:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615032:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615038:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615043:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615049:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615055:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615061:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615067:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615075:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615080:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615085:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615091:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615097:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615103:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615109:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615114:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615120:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615126:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615131:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615220:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615225:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615230:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615236:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615241:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615273:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615279:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615285:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615292:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615297:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615314:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615321:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615327:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615333:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615339:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.615346:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201259.626228:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9b0040723e00:6684] 0 exiting: rc = 1 00000100:00100000:3.0:1788201259.626375:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9b0040722200:6685] 1 exiting: rc = 0 00000100:00100000:1.0:1788201259.626635:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626646:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626651:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626656:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626661:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626669:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626674:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626680:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626685:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626690:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626748:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626754:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626759:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626764:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626769:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626775:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626781:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626787:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626792:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626798:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626803:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626809:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626814:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626819:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626841:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626847:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626853:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626858:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626863:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626869:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626875:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626880:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626885:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626891:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626895:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626901:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626906:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626911:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626916:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626921:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626927:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626932:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626936:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626942:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626947:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626953:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626958:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626963:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626969:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626974:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626979:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626985:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626990:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.626995:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.627000:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.627005:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.627451:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.627459:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.627476:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.627491:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.627496:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.627500:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.627505:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.627511:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.628268:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9b0040722800:6687] 1 exiting: rc = 0 00000100:00100000:0.0:1788201259.628278:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9b0040722a00:6686] 0 exiting: rc = 1 00000100:00100000:1.0:1788201259.629397:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629414:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629421:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629427:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629432:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629438:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629443:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629450:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629456:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629661:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629670:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629676:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629681:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629762:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629770:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629776:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629784:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629790:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629797:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629803:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629809:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629816:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629822:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629829:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629835:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629857:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629864:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629870:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629875:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629893:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629898:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629905:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629910:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629916:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629921:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629927:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629933:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629953:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629960:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629965:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629971:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629976:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629983:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629990:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.629996:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630003:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630009:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630015:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630021:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630040:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630047:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630053:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630058:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630063:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630068:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630073:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630079:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630085:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630091:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630097:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630102:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630117:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630287:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201259.630300:0:13370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788201259.644938:0:13370:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788201278.122876:0:13989:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788201286.465537:0:14450:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788201286.465545:0:14450:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788201286.465856:0:14450:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9aff0131b800 00000020:01000004:2.0:1788201286.465875:0:14450:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788201286.465885:0:14450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788201286.465904:0:14450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9b000514b380) 00000020:00000080:2.0:1788201286.465922:0:14450:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788201286.484598:0:14450:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788201286.490151:0:14450:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788201286.490550:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1788201286.490889:0:14450:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788201286.490960:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1788201286.491065:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1788201286.491348:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1788201286.491452:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1788201286.491554:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1788201286.491962:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1788201286.493429:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 465: rc = 0 00100000:10000000:2.0:1788201286.493531:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 465: rc = 0 00100000:10000000:2.0:1788201286.494043:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 651: rc = 0 00100000:10000000:2.0:1788201286.494442:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 651: rc = 0 00100000:10000000:2.0:1788201286.495008:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 651: rc = 0 00100000:10000000:2.0:1788201286.495387:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 651: rc = 0 00100000:10000000:2.0:1788201286.495654:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 651: rc = 0 00100000:10000000:2.0:1788201286.496537:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 651: rc = 0 00100000:10000000:2.0:1788201286.496984:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 651: rc = 0 00100000:10000000:3.0:1788201286.497621:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 651: rc = 0 00100000:10000000:3.0:1788201286.498045:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 651: rc = 0 00100000:10000000:3.0:1788201286.498359:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 651: rc = 0 00100000:10000000:3.0:1788201286.498845:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 651: rc = 0 00100000:10000000:3.0:1788201286.499124:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 651: rc = 0 00100000:10000000:3.0:1788201286.500341:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 575: rc = 0 00100000:10000000:3.0:1788201286.502296:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 575: rc = 0 00100000:10000000:3.0:1788201286.502605:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 575: rc = 0 00100000:10000000:3.0:1788201286.502866:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 575: rc = 0 00100000:10000000:3.0:1788201286.507581:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 575: rc = 0 00100000:10000000:3.0:1788201286.508187:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 575: rc = 0 00100000:10000000:3.0:1788201286.508473:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 575: rc = 0 00100000:10000000:3.0:1788201286.508740:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 575: rc = 0 00100000:10000000:3.0:1788201286.508998:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 575: rc = 0 00100000:10000000:3.0:1788201286.509327:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 575: rc = 0 00100000:10000000:3.0:1788201286.509589:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 575: rc = 0 00100000:10000000:3.0:1788201286.509860:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 575: rc = 0 00100000:10000000:3.0:1788201286.510167:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 575: rc = 0 00100000:10000000:3.0:1788201286.510447:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 575: rc = 0 00100000:10000000:3.0:1788201286.517447:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 575: rc = 0 00100000:10000000:3.0:1788201286.518060:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 575: rc = 0 00100000:10000000:3.0:1788201286.518408:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 575: rc = 0 00100000:10000000:3.0:1788201286.522466:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 575: rc = 0 00100000:10000000:3.0:1788201286.522928:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 575: rc = 0 00100000:10000000:3.0:1788201286.523225:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 575: rc = 0 00100000:10000000:3.0:1788201286.523478:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 575: rc = 0 00100000:10000000:3.0:1788201286.523765:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 575: rc = 0 00100000:10000000:3.0:1788201286.524029:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 575: rc = 0 00100000:10000000:3.0:1788201286.525382:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 575: rc = 0 00100000:10000000:3.0:1788201286.525874:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 575: rc = 0 00100000:10000000:3.0:1788201286.527240:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 575: rc = 0 00100000:10000000:3.0:1788201286.527580:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 575: rc = 0 00100000:10000000:0.0:1788201286.530640:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 575: rc = 0 00100000:10000000:0.0:1788201286.530941:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 575: rc = 0 00100000:10000000:0.0:1788201286.531249:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 575: rc = 0 00100000:10000000:0.0:1788201286.531509:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 575: rc = 0 00100000:10000000:0.0:1788201286.531761:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 575: rc = 0 00100000:10000000:0.0:1788201286.532198:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 564: rc = 0 00100000:10000000:0.0:1788201286.532817:0:14450:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1788201286.533005:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 647: rc = 0 00100000:10000000:1.0:1788201286.540929:0:14450:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788201286.541050:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 647: rc = 0 00100000:10000000:1.0:1788201286.542230:0:14450:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1788201286.542327:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 647: rc = 0 00100000:10000000:1.0:1788201286.543928:0:14450:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788201286.544034:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 466: rc = 0 00100000:10000000:1.0:1788201286.545953:0:14450:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788201286.546054:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 466: rc = 0 00100000:10000000:1.0:1788201286.546606:0:14450:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788201286.546682:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 466: rc = 0 00000020:00000080:1.0:1788201286.547366:0:14450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788201286.547376:0:14450:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788201286.547465:0:14450:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72011f792b787ad8 00000020:01000004:1.0:1788201286.547476:0:14450:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788201286.547482:0:14450:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788201286.547488:0:14450:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9aff0131b800 from MGS 00000020:01000004:1.0:1788201286.547492:0:14450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788201286.547505:0:14450:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9b00067e19c0) 00000020:00000080:1.0:1788201286.547517:0:14450:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788201286.547593:0:14450:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9aff0131b800 from MGS, refs=2 00080000:01000000:1.0:1788201286.547599:0:14450:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788201286.547607:0:14450:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72011f792b787ae6 00000100:00100000:1.0:1788201286.547784:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788201286.547921:0:14450:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788201286.547928:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788201286.548596:0:14450:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788201286.548604:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788201286.550460:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201286.551012:0:14450:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788201286.551020:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788201286.553036:0:14450:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788201286.553052:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788201286.554077:0:14450:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788201286.554088:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788201286.556211:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201286.556218:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201286.556220:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201286.556610:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201286.556613:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201286.556615:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201286.563352:0:14450:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788201286.566297:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788201286.575373:0:14450:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788201286.575401:0:14450:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788201286.575405:0:14450:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788201286.577242:0:14459:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788201286.582294:0:14450:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788201286.582440:0:14450:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788201286.584311:0:14450:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788201286.590587:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201286.590982:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788201286.590992:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788201286.600786:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788201286.600827:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788201286.601397:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788201286.601405:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788201286.609885:0:14450:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788201286.609920:0:14450:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.114@tcp' 00000020:01000004:2.0:1788201286.609922:0:14450:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788201286.609962:0:14450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.114@tcp (typ=mgc) 00000020:00000080:2.0:1788201286.609979:0:14450:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.114@tcp (ffff9b00051499c0) 00000020:00000080:2.0:1788201286.610004:0:14450:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788201286.610110:0:14450:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b003f3c5000@MGC192.168.203.114@tcp: add connection 192.168.203.114@tcp at head 00010000:00010000:2.0:1788201286.610379:0:14450:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.114@tcp-0 is initialized 00000040:01000000:2.0:1788201286.610388:0:14450:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788201286.615782:0:14464:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788201286.615824:0:14466:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788201286.615908:0:14450:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.114@tcp (uuid bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9) 00000020:00000080:2.0:1788201286.615938:0:14450:0:(genops.c:1406:class_connect()) connect: client bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9, cookie 0x72011f792b787af4 00000100:00080000:2.0:1788201286.615955:0:14450:0:(import.c:510:import_select_connection()) MGC192.168.203.114@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201286.615962:0:14450:0:(import.c:624:import_select_connection()) MGC192.168.203.114@tcp: import ffff9b003f3c5000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788201286.616009:0:14450:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b003b0aea00 x1875064622498816/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201286.616043:0:14450:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9->MGS 00000100:00100000:0.0:1788201286.616159:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3291:1875064622498816:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788201286.616283:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201286.616377:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622498816 00000100:00100000:0.0:1788201286.616386:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622498816 00000100:00100000:0.0:1788201286.616425:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201286.616435:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3291:x1875064622498816:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788201286.616465:0:14461:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9@0@lo t0 exp 0000000000000000 cur 365 last 0 00000020:00000080:0.0:1788201286.616504:0:14461:0:(genops.c:1406:class_connect()) connect: client bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9, cookie 0x72011f792b787afb 00000100:00080000:0.0:1788201286.616670:0:14461:0:(import.c:65:import_set_state_nolock()) ffff9b003fdde000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201286.616734:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+5:3291:x1875064622498816:12345-0@lo:250:mount.lustre.0 Request processed in 299us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201286.616743:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201286.616784:0:3291:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.114@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788201286.616794:0:3291:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.114@tcp: connect to target with instance 0 00000100:00080000:0.0:1788201286.616802:0:3291:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.114@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788201286.616807:0:3291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788201286.616811:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b003f3c5000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788201286.616814:0:3291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788201286.616822:0:3291:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788201286.616828:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3291:1875064622498816:0@lo:250:mount.lustre.0 00000020:01000004:2.0:1788201286.616923:0:14450:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788201286.616930:0:14450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788201286.616947:0:14450:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9b0005148000) 00000020:00000080:2.0:1788201286.616960:0:14450:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788201286.637636:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201286.637868:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788201286.637875:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788201286.646508:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788201286.646533:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788201286.647422:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788201286.647432:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788201286.649665:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201286.649882:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788201286.649890:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788201286.650917:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788201286.650925:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788201286.733129:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201286.733406:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788201286.733414:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788201286.737481:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788201286.737501:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788201286.739744:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201286.739926:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788201286.739939:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788201286.745234:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788201286.745255:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788201286.750833:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201286.751016:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788201286.751023:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788201286.759260:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788201286.759281:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788201286.762397:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201286.762545:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788201286.762550:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788201286.764521:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788201286.764534:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788201286.788983:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201286.789449:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788201286.789456:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788201286.790580:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788201286.790591:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788201286.791567:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788201286.791576:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788201286.793079:0:14450:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788201286.793108:0:14450:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788201286.793124:0:14450:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.114@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788201286.793315:0:14450:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788201286.793348:0:14450:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.114@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788201286.793353:0:14450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788201286.793357:0:14450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201286.793359:0:14450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201286.793360:0:14450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201286.793361:0:14450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201286.793362:0:14450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201286.793364:0:14450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201286.793365:0:14450:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201286.793366:0:14450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201286.793367:0:14450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201286.793370:0:14450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788201286.793372:0:14450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201286.793373:0:14450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201286.793374:0:14450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201286.793375:0:14450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201286.793376:0:14450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201286.793377:0:14450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201286.793378:0:14450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201286.793379:0:14450:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201286.793380:0:14450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201286.793381:0:14450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201286.793405:0:14450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788201286.793426:0:14450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622498944:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201286.793501:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201286.793547:0:14450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00100b49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201286.795250:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622498944 00000100:00100000:1.0:1788201286.795266:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622498944 00000100:00100000:1.0:1788201286.795337:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201286.795349:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+5:14450:x1875064622498944:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788201286.795408:0:14463:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788201286.795413:0:14463:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788201286.795417:0:14463:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788201286.795888:0:14484:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788201286.796352:0:14463:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788201286.797379:0:14485:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788201286.797385:0:14485:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788201286.797388:0:14485:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788201286.797423:0:14485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788201286.797697:0:14463:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788201286.797707:0:14463:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788201286.801817:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+5:14450:x1875064622498944:12345-0@lo:253:mount.lustre.0 Request processed in 6460us (8305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201286.801836:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201286.801959:0:14450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622498944:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788201286.801976:0:14450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788201286.801980:0:14450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201286.801982:0:14450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201286.801983:0:14450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201286.801984:0:14450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201286.801985:0:14450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201286.801986:0:14450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201286.801987:0:14450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201286.801994:0:14450:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201286.801996:0:14450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201286.801997:0:14450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788201286.802018:0:14450:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9aff0131b800 from lustre-MDT0000 10000000:01000000:3.0:1788201286.802044:0:14450:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788201286.802047:0:14450:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788201286.802051:0:14450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b00051499c0 10000000:01000000:3.0:1788201286.802055:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201286.802062:0:14450:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b00051499c0 from 1 10000000:01000000:3.0:1788201286.802065:0:14450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788201286.802103:0:14450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b787b09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.802124:0:14450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b787b09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.802163:0:14450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b787b09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201286.802186:0:14450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622499072:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201286.802226:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201286.802255:0:14450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201286.802308:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622499072 00000100:00100000:1.0:1788201286.802314:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622499072 00000100:00100000:1.0:1788201286.802352:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201286.802361:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+5:14450:x1875064622499072:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201286.802374:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201286.802389:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0001680000/0x72011f792b787b10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787b09 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201286.802413:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0001680000/0x72011f792b787b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787b09 expref: 6 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201286.802423:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0001680000/0x72011f792b787b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787b09 expref: 6 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201286.802431:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001680000, rc 0) 00000100:00100000:1.0:1788201286.802470:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+6:14450:x1875064622499072:12345-0@lo:101:mount.lustre.0 Request processed in 111us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201286.802486:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201286.802666:0:14450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622499072:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201286.802679:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b787b09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787b10 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.802687:0:14450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b787b09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787b10 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201286.802733:0:14450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622499200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201286.802769:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201286.802790:0:14450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201286.802836:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622499200 00000100:00100000:1.0:1788201286.802840:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622499200 00000100:00100000:1.0:1788201286.802870:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201286.802876:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+6:14450:x1875064622499200:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201286.803157:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+6:14450:x1875064622499200:12345-0@lo:501:mount.lustre.0 Request processed in 255us (361us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201286.803166:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201286.803420:0:14450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622499200:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788201286.803447:0:14450:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788201286.803574:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b787b09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787b10 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.803583:0:14450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b787b09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787b10 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201286.803591:0:14450:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9aff0131b800 10000000:01000000:3.0:1788201286.803596:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788201286.803601:0:14450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9aff0131b800 10000000:01000000:3.0:1788201286.803603:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788201286.803606:0:14450:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9aff0131b800 from 1 10000000:01000000:3.0:1788201286.803609:0:14450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788201286.803632:0:14450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b787b17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.803639:0:14450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b787b17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.803648:0:14450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b787b17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201286.803661:0:14450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622499328:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201286.803692:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201286.803720:0:14450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201286.803770:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622499328 00000100:00100000:2.0:1788201286.803775:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622499328 00000100:00100000:2.0:1788201286.803808:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201286.803816:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0002f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+6:14450:x1875064622499328:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201286.803826:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201286.803839:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b001f8f0a00/0x72011f792b787b1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787b17 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201286.803856:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b001f8f0a00/0x72011f792b787b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787b17 expref: 7 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201286.803865:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b001f8f0a00/0x72011f792b787b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787b17 expref: 7 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201286.803873:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0a00, rc 0) 00000100:00100000:2.0:1788201286.803911:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0002f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+7:14450:x1875064622499328:12345-0@lo:101:mount.lustre.0 Request processed in 95us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201286.803916:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201286.804018:0:14450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622499328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201286.804037:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b787b17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787b1e expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.804045:0:14450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b787b17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787b1e expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201286.804055:0:14450:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788201286.804193:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b787b17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787b1e expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.804201:0:14450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0000030c00/0x72011f792b787b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787b1e expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201286.804207:0:14450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788201286.804211:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201286.804215:0:14450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9aff0131b800 10000000:01000000:3.0:1788201286.804218:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788201286.804221:0:14450:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788201286.804223:0:14450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788201286.804237:0:14450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000030200/0x72011f792b787b25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.804243:0:14450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0000030200/0x72011f792b787b25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.804249:0:14450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0000030200/0x72011f792b787b25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201286.804262:0:14450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622499456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201286.804298:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201286.804319:0:14450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201286.804380:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622499456 00000100:00100000:2.0:1788201286.804384:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622499456 00000100:00100000:2.0:1788201286.804407:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201286.804414:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+7:14450:x1875064622499456:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201286.804421:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201286.804432:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b001f8f1600/0x72011f792b787b2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787b25 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201286.804459:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b001f8f1600/0x72011f792b787b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787b25 expref: 8 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201286.804468:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b001f8f1600/0x72011f792b787b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787b25 expref: 8 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201286.804485:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1600, rc 0) 00000100:00100000:2.0:1788201286.804514:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+8:14450:x1875064622499456:12345-0@lo:101:mount.lustre.0 Request processed in 101us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201286.804519:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201286.804697:0:14450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622499456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201286.804708:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0000030200/0x72011f792b787b25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787b2c expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.804716:0:14450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0000030200/0x72011f792b787b25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787b2c expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201286.804758:0:14450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622499584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201286.804783:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201286.804803:0:14450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201286.804847:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622499584 00000100:00100000:1.0:1788201286.804851:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622499584 00000100:00100000:1.0:1788201286.804879:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201286.804887:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+8:14450:x1875064622499584:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201286.805280:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+9:14450:x1875064622499584:12345-0@lo:501:mount.lustre.0 Request processed in 393us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201286.805299:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201286.805747:0:14450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622499584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201286.805782:0:14450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622499712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201286.805825:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201286.805844:0:14450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201286.805891:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622499712 00000100:00100000:1.0:1788201286.805896:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622499712 00000100:00100000:1.0:1788201286.805928:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201286.805936:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+9:14450:x1875064622499712:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201286.806248:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+9:14450:x1875064622499712:12345-0@lo:503:mount.lustre.0 Request processed in 311us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201286.806254:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201286.806400:0:14450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622499712:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201286.806856:0:14486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14486:1875064622499840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201286.806901:0:14486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201286.806932:0:14486:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00108d4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201286.806984:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622499840 00000100:00100000:1.0:1788201286.806989:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622499840 00000100:00100000:1.0:1788201286.807023:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788201286.807030:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+9:14486:x1875064622499840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201286.807398:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+9:14486:x1875064622499840:12345-0@lo:502:llog_process_th.0 Request processed in 367us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201286.807406:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201286.807553:0:14486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14486:1875064622499840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201286.807578:0:14486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201286.807589:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201286.807592:0:14486:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788201286.807596:0:14486:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788201286.807600:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201286.807613:0:14486:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9b000514cd40) 00000020:00000080:2.0:1788201286.807631:0:14486:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788201286.807636:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788201286.807707:0:14486:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788201286.807716:0:14486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72011f792b787b3a 00000020:00000080:2.0:1788201286.807911:0:14486:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788201286.807917:0:14486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201286.807921:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201286.807927:0:14486:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788201286.807932:0:14486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201286.807935:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201286.807937:0:14486:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788201286.807940:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201286.807947:0:14486:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9b0010a4b380) 00000020:00000080:2.0:1788201286.807957:0:14486:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788201286.807960:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788201286.807962:0:14486:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788201286.807965:0:14486:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788201286.807971:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788201286.808008:0:14486:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9aff0131b800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788201286.808021:0:14486:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9b0010a48000) 00000020:00000080:2.0:1788201286.808028:0:14486:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788201286.808068:0:14486:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788201286.808074:0:14486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72011f792b787b4f 00000020:00000080:2.0:1788201286.808290:0:14486:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788201286.808297:0:14486:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788201286.808302:0:14486:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x72011f792b787b56 00080000:01000000:2.0:1788201286.808306:0:14486:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788201286.808310:0:14486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72011f792b787b5d 00010000:00010000:2.0:1788201286.879074:0:14486:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788201286.880005:0:14486:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1788201286.880634:0:14486:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788201286.881224:0:14486:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9b0010a4cd40) 00000020:00000080:2.0:1788201286.881244:0:14486:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788201286.881314:0:14486:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788201286.881321:0:14486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72011f792b787b6b 00000020:00000080:2.0:1788201286.882712:0:14486:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788201286.885896:0:14486:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x72011f792b787b72 00000020:00000080:1.0:1788201286.887277:0:14486:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788201286.887292:0:14486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201286.887299:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201286.887302:0:14486:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788201286.887306:0:14486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201286.887311:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201286.887313:0:14486:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788201286.887317:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788201286.887360:0:14486:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788201286.887375:0:14486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201286.887384:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201286.887386:0:14486:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788201286.887389:0:14486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201286.887391:0:14486:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1788201286.887393:0:14486:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201286.887395:0:14486:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201286.887396:0:14486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201286.887398:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201286.887400:0:14486:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788201286.887402:0:14486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201286.887405:0:14486:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788201286.887408:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201286.887409:0:14486:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788201286.887412:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201286.887417:0:14486:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:01000000:1.0:1788201286.887441:0:14486:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788201286.887444:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201286.887458:0:14486:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b00067e0000) 00000020:00000080:1.0:1788201286.887517:0:14486:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788201286.887525:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201286.887581:0:14486:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788201286.887587:0:14486:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788201286.887593:0:14486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72011f792b787b80 00010000:00080000:1.0:1788201286.887627:0:14486:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b00050c6000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.114@tcp at head 00010000:00010000:1.0:1788201286.887837:0:14486:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788201286.888729:0:14486:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788201286.888770:0:14486:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788201286.889642:0:14486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201286.889709:0:14486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788201286.889775:0:14486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788201286.891669:0:14490:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788201286.891675:0:14490:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788201286.892548:0:14486:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201286.892562:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788201286.892601:0:14486:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788201286.892618:0:14486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72011f792b787b87 00000100:00080000:1.0:1788201286.892629:0:14486:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201286.892636:0:14486:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b00050c6000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788201286.892671:0:14486:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b002722d880 x1875064622499968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201286.892701:0:14486:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788201286.892763:0:14486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201286.892766:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201286.892768:0:14486:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788201286.892771:0:14486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201286.892773:0:14486:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788201286.892775:0:14486:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201286.892776:0:14486:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201286.892777:0:14486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201286.892780:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201286.892781:0:14486:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788201286.892784:0:14486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201286.892787:0:14486:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788201286.892790:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201286.892791:0:14486:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788201286.892794:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201286.892797:0:14486:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:01000000:1.0:1788201286.892821:0:14486:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788201286.892824:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201286.892834:0:14486:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b00067e4d40) 00000020:00000080:1.0:1788201286.892845:0:14486:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788201286.892850:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201286.892898:0:14486:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788201286.892904:0:14486:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000100:00100000:0.0:1788201286.893054:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622499968:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788201286.893103:0:3291:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064622499968 offset 0 length 520: 4 00000100:00100000:3.0:1788201286.893353:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3293:1875064622500096:0@lo:400:kworker.0 00000100:00100000:3.0:1788201286.893394:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201286.893510:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622500096 00000100:00100000:2.0:1788201286.893517:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622500096 00000100:00100000:2.0:1788201286.893558:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201286.893573:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+9:3293:x1875064622500096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201286.893635:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+9:3293:x1875064622500096:12345-0@lo:400:kworker.0 Request processed in 63us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201286.893642:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201286.893744:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3293:1875064622500096:0@lo:400:kworker.0 00000020:00000080:1.0:1788201286.893803:0:14486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72011f792b787b95 00010000:00080000:1.0:1788201286.893837:0:14486:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b000f3de800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.114@tcp at head 00010000:00010000:1.0:1788201286.894270:0:14486:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788201286.894471:0:14486:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788201286.894494:0:14486:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788201286.895670:0:14486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201286.895736:0:14486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788201286.895782:0:14486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788201286.896293:0:14492:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788201286.896297:0:14492:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788201286.900375:0:14486:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201286.900391:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788201286.900431:0:14486:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788201286.900450:0:14486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72011f792b787b9c 00000100:00080000:3.0:1788201286.900474:0:14486:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201286.900480:0:14486:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b000f3de800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788201286.900526:0:14486:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b004052f100 x1875064622500224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201286.900556:0:14486:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788201286.900626:0:14486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201286.900630:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201286.900632:0:14486:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788201286.900635:0:14486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201286.900639:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201286.900640:0:14486:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788201286.900642:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201286.900644:0:14486:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788201286.900646:0:14486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201286.900648:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201286.900649:0:14486:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788201286.900651:0:14486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201286.900654:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201286.900655:0:14486:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788201286.900659:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788201286.900691:0:14486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14486:1875064622500352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201286.900768:0:14486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201286.900801:0:14486:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201286.901031:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622500224:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788201286.901061:0:3291:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064622500224 offset 0 length 520: 4 00000100:00100000:1.0:1788201286.901183:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622500352 00000100:00100000:1.0:1788201286.901191:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622500352 00000100:00100000:1.0:1788201286.901238:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201286.901248:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+9:14486:x1875064622500352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201286.901505:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+9:14486:x1875064622500352:12345-0@lo:502:llog_process_th.0 Request processed in 259us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201286.901514:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201286.901747:0:14486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14486:1875064622500352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201286.901773:0:14486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201286.901779:0:14486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201286.901781:0:14486:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788201286.901784:0:14486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788201286.901937:0:14450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788201286.901957:0:14450:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788201286.901980:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000030200/0x72011f792b787b25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787b2c expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201286.901991:0:14450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0000030200/0x72011f792b787b25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787b2c expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201286.901999:0:14450:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9aff0131b800 from 1 10000000:01000000:0.0:1788201286.902001:0:14450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201286.902031:0:14450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b000676f200/0x72011f792b787ba3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201286.902040:0:14450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b000676f200/0x72011f792b787ba3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201286.902049:0:14450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b000676f200/0x72011f792b787ba3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201286.902063:0:14450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622500480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201286.902093:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201286.902161:0:14450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005094600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201286.902279:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622500480 00000100:00100000:3.0:1788201286.902284:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622500480 00000100:00100000:3.0:1788201286.902316:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788201286.902324:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+9:14450:x1875064622500480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201286.902343:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201286.902356:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0000030e00/0x72011f792b787baa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787ba3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.902376:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0000030e00/0x72011f792b787baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787ba3 expref: 10 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.902385:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0000030e00/0x72011f792b787baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787ba3 expref: 10 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.902393:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000030e00, rc 0) 00000100:00100000:3.0:1788201286.902429:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+10:14450:x1875064622500480:12345-0@lo:101:mount.lustre.0 Request processed in 104us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201286.902435:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788201286.903053:0:14450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622500480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201286.903068:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b000676f200/0x72011f792b787ba3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787baa expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201286.903078:0:14450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b000676f200/0x72011f792b787ba3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787baa expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201286.903666:0:14450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622500608:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788201286.905334:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201286.905380:0:14450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005094600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201286.905461:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622500608 00000100:00100000:1.0:1788201286.905469:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622500608 00000100:00100000:1.0:1788201286.905525:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201286.905535:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+10:14450:x1875064622500608:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788201286.905558:0:14462:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788201286.905564:0:14462:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788201286.905651:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+10:14450:x1875064622500608:12345-0@lo:256:mount.lustre.0 Request processed in 116us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201286.905659:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201286.905779:0:14450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622500608:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788201286.906620:0:14450:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201286.906679:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b000676f200/0x72011f792b787ba3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787baa expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201286.906690:0:14450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b000676f200/0x72011f792b787ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787baa expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201286.906698:0:14450:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9aff0131b800 from 1 10000000:01000000:0.0:1788201286.906701:0:14450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201286.906733:0:14450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787bb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201286.906740:0:14450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787bb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201286.906750:0:14450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787bb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201286.906823:0:14450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622500736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201286.906867:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201286.906904:0:14450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005094600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201286.908709:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622500736 00000100:00100000:3.0:1788201286.908722:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622500736 00000100:00100000:3.0:1788201286.908782:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788201286.908793:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+10:14450:x1875064622500736:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201286.908809:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201286.908827:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0000031c00/0x72011f792b787bb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787bb1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.908850:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0000031c00/0x72011f792b787bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787bb1 expref: 11 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.908870:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0000031c00/0x72011f792b787bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787bb1 expref: 11 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.908880:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000031c00, rc 0) 00000100:00100000:3.0:1788201286.908963:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+11:14450:x1875064622500736:12345-0@lo:101:mount.lustre.0 Request processed in 173us (2095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201286.908969:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201286.909413:0:14450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622500736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201286.909430:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787bb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787bb8 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201286.909440:0:14450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787bb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787bb8 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201286.909506:0:14450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622500864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201286.909543:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201286.909581:0:14450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005094600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201286.909629:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622500864 00000100:00100000:1.0:1788201286.909634:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622500864 00000100:00100000:1.0:1788201286.909667:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201286.909675:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+11:14450:x1875064622500864:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201286.910207:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+11:14450:x1875064622500864:12345-0@lo:501:mount.lustre.0 Request processed in 532us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201286.910215:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201286.910354:0:14450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622500864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201286.910388:0:14450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622500992:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201286.910429:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201286.910449:0:14450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005094600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201286.911228:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622500992 00000100:00100000:1.0:1788201286.911235:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622500992 00000100:00100000:1.0:1788201286.911281:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201286.911289:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+11:14450:x1875064622500992:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201286.911463:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+11:14450:x1875064622500992:12345-0@lo:503:mount.lustre.0 Request processed in 173us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201286.911470:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201286.911607:0:14450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f84a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622500992:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201286.912188:0:14494:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f84a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14494:1875064622501120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201286.912234:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201286.912261:0:14494:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00050946c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201286.913567:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622501120 00000100:00100000:1.0:1788201286.913579:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622501120 00000100:00100000:1.0:1788201286.913637:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201286.913647:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+11:14494:x1875064622501120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201286.913947:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+11:14494:x1875064622501120:12345-0@lo:502:llog_process_th.0 Request processed in 301us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201286.913954:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201286.914192:0:14494:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f84a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14494:1875064622501120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201286.914226:0:14494:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201286.914237:0:14494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201286.914239:0:14494:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788201286.914246:0:14494:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9aff0131b800 00000020:00000080:3.0:1788201286.914248:0:14494:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201286.914255:0:14494:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201286.914258:0:14494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201286.914259:0:14494:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788201286.914261:0:14494:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201286.914264:0:14494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201286.914265:0:14494:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788201286.914268:0:14494:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9aff0131b800 00000020:00000080:3.0:1788201286.914270:0:14494:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201286.914321:0:14494:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201286.914325:0:14494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201286.914327:0:14494:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788201286.914329:0:14494:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201286.914332:0:14494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201286.914333:0:14494:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788201286.914337:0:14494:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9aff0131b800 00000020:00000080:3.0:1788201286.914339:0:14494:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788201286.914383:0:14494:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14494:1875064622501248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201286.914432:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201286.914459:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622501248 00000100:00100000:3.0:1788201286.914464:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622501248 00000100:00100000:3.0:1788201286.914488:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201286.914496:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+11:14494:x1875064622501248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201286.914633:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+11:14494:x1875064622501248:12345-0@lo:502:llog_process_th.0 Request processed in 137us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201286.914640:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201286.914678:0:14494:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201286.914692:0:14494:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14494:1875064622501248:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201286.914708:0:14494:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201286.914712:0:14494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201286.914714:0:14494:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788201286.914717:0:14494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788201286.917205:0:14450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788201286.917238:0:14450:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201286.917259:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787bb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787bb8 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201286.917272:0:14450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787bb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787bb8 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201286.917318:0:14450:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788201286.917321:0:14450:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9aff0131b800 10000000:01000000:1.0:1788201286.917340:0:14450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9aff0131b800 10000000:01000000:1.0:1788201286.917344:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201286.917350:0:14450:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9aff0131b800 from 1 10000000:01000000:1.0:1788201286.917353:0:14450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201286.917994:0:14450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b787bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201286.918005:0:14450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b787bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201286.918016:0:14450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b787bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201286.918040:0:14450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622501376:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201286.918122:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201286.918185:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622501376 00000100:00100000:1.0:1788201286.918191:0:14450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9aff01b6bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201286.918193:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622501376 00000100:00100000:3.0:1788201286.918232:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201286.918242:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+11:14450:x1875064622501376:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201286.918255:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201286.918268:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0000030400/0x72011f792b787bc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787bbf expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.918294:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0000030400/0x72011f792b787bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787bbf expref: 12 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.918304:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0000030400/0x72011f792b787bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787bbf expref: 12 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.918312:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000030400, rc 0) 00000100:00100000:3.0:1788201286.918349:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:14450:x1875064622501376:12345-0@lo:101:mount.lustre.0 Request processed in 109us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201286.918356:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201286.918537:0:14450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622501376:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201286.918551:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b787bbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787bc6 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201286.918561:0:14450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b787bbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787bc6 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201286.919201:0:14450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622501504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201286.919239:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201286.919269:0:14450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9aff01b6bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201286.920002:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622501504 00000100:00100000:2.0:1788201286.920010:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622501504 00000100:00100000:2.0:1788201286.920056:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788201286.920065:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:14450:x1875064622501504:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201286.921310:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:14450:x1875064622501504:12345-0@lo:501:mount.lustre.0 Request processed in 1241us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201286.921321:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788201286.924891:0:14450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622501504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201286.924947:0:14450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622501632:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201286.925017:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201286.926709:0:14450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9aff01b6bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201286.931369:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622501632 00000100:00100000:0.0:1788201286.931384:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622501632 00000100:00100000:0.0:1788201286.931435:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788201286.931451:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00331dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:14450:x1875064622501632:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201286.931701:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00331dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:14450:x1875064622501632:12345-0@lo:503:mount.lustre.0 Request processed in 251us (6683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201286.931709:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788201286.931891:0:14450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622501632:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201286.932341:0:14500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14500:1875064622501760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201286.932385:0:14500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201286.932423:0:14500:0:(client.c:2702:ptlrpc_set_wait()) set ffff9aff01b6bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201286.932435:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622501760 00000100:00100000:2.0:1788201286.932440:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622501760 00000100:00100000:2.0:1788201286.933316:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201286.933379:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00331ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:14500:x1875064622501760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201286.934261:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00331ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:14500:x1875064622501760:12345-0@lo:502:llog_process_th.0 Request processed in 932us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201286.934346:0:14500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14500:1875064622501760:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788201286.934429:0:14500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788201286.934443:0:14500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9b00409399c0) 00000020:00000080:3.0:1788201286.934462:0:14500:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788201286.934626:0:14500:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9aff0131b800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788201286.934631:0:14500:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9aff0131b800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788201286.934633:0:14500:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9aff0131b800 4 00010000:00080000:3.0:1788201286.934662:0:14500:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b0026fef800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.114@tcp at head 00000100:00100000:2.0:1788201286.935576:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788201286.939411:0:14500:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788201286.939529:0:14500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788201286.939564:0:14500:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788201286.939579:0:14500:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x72011f792b787bd4 00000100:00080000:3.0:1788201286.939590:0:14500:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201286.941939:0:14500:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b0026fef800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788201286.942001:0:14500:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b004052f800 x1875064622501888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201286.942077:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875064622501888:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201286.942177:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201286.942253:0:14500:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788201286.942425:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622501888 00000100:00100000:2.0:1788201286.942433:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622501888 00000100:00100000:2.0:1788201286.942486:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201286.942494:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1875064622501888:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788201286.942902:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1875064622501888:12345-0@lo:38:llog_process_th.0 Request processed in 405us (723us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201286.942911:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201286.943090:0:14500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14500:1875064622502016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201286.943172:0:14500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201286.943203:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622502016 00000100:00100000:3.0:1788201286.943208:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622502016 00000100:00100000:3.0:1788201286.943241:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201286.943249:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:14500:x1875064622502016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201286.945098:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:14500:x1875064622502016:12345-0@lo:502:llog_process_th.0 Request processed in 1842us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201286.945119:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201286.945195:0:14500:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00108d4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201286.945220:0:14500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14500:1875064622502016:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788201286.945261:0:14500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788201286.946189:0:14450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788201286.946214:0:14450:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201286.946232:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b787bbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787bc6 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201286.946244:0:14450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0001680600/0x72011f792b787bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787bc6 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788201286.946287:0:14450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788201286.946289:0:14450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201286.946291:0:14450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201286.946292:0:14450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201286.946293:0:14450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201286.946295:0:14450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201286.946296:0:14450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201286.946297:0:14450:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201286.946299:0:14450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201286.946300:0:14450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201286.946304:0:14450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788201286.946306:0:14450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201286.946307:0:14450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201286.946308:0:14450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201286.946309:0:14450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201286.946310:0:14450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201286.946311:0:14450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201286.946313:0:14450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201286.946314:0:14450:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201286.946315:0:14450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201286.946316:0:14450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201286.946337:0:14450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788201286.946355:0:14450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622502144:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201286.946401:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201286.946431:0:14450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201286.946456:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622502144 00000100:00100000:3.0:1788201286.946467:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622502144 00000100:00100000:3.0:1788201286.946503:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201286.946511:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:14450:x1875064622502144:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788201286.946538:0:14461:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788201286.946550:0:14461:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788201286.949690:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201286.949704:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b0026fef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201286.949711:0:3291:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788201286.949716:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875064622501888:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1788201286.999741:0:14461:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201286.999758:0:14461:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788201286.999805:0:14484:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788201286.999809:0:14484:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788201286.999834:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b000676ee00/0x72011f792b787bdb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201286.999852:0:14484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0000030e00/0x72011f792b787baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787ba3 expref: 12 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201287.000053:0:14484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b000676ee00/0x72011f792b787bdb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201287.000096:0:14484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0000030e00/0x72011f792b787baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b787ba3 expref: 12 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201287.000119:0:14484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0000030e00/0x72011f792b787baa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b787ba3 expref: 12 pid: 14461 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201287.000160:0:14484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f87b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14484:1875064622502272:0@lo:104: 00000100:00100000:0.0:1788201287.000236:0:14484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201287.000761:0:14484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00050949c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201287.001308:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622502272 00000100:00100000:2.0:1788201287.001316:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622502272 00000100:00100000:2.0:1788201287.001430:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201287.001441:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+3:14484:x1875064622502272:12345-0@lo:104: 00010000:00010000:2.0:1788201287.001459:0:14451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b000676f200/0x72011f792b787ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b787baa expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201287.001545:0:14451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201287.001553:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+3:14484:x1875064622502272:12345-0@lo:104: Request processed in 114us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201287.001560:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201287.001579:0:14484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f87b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14484:1875064622502272:0@lo:104: 00010000:00010000:3.0:1788201287.001602:0:14484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b000676ee00/0x72011f792b787bdb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201287.001656:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201287.001664:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b000676f200/0x72011f792b787ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b787baa expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201287.001672:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f200 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1788201287.001676:0:14457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b000676f200/0x72011f792b787ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b787baa expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201287.001699:0:14457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b000676f200/0x72011f792b787ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b787baa expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201287.001706:0:14457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b000676f200/0x72011f792b787ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b787baa expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201287.001712:0:14457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201287.001755:0:14457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b000676f200/0x72011f792b787ba3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787baa expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201287.001762:0:14457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201287.001798:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b000676f200/0x72011f792b787ba3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787baa expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201287.001805:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b000676f200/0x72011f792b787ba3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787baa expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201287.001823:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201287.001825:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201287.001827:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201287.001845:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201287.001857:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3295:1875064622502400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201287.001904:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201287.002532:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622502400 00000100:00100000:2.0:1788201287.002539:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622502400 00010000:00010000:2.0:1788201287.002566:0:14453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0000030e00/0x72011f792b787baa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b787ba3 expref: 13 pid: 14461 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201287.002611:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201287.002620:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+13:3295:x1875064622502400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201287.002942:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201287.002949:0:14453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0000030e00/0x72011f792b787baa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b787ba3 expref: 13 pid: 14461 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201287.002963:0:14453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0000030e00/0x72011f792b787baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b787ba3 expref: 13 pid: 14461 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201287.002980:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0000030e00/0x72011f792b787baa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b787ba3 expref: 13 pid: 14461 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201287.002996:0:14453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b000676ee00/0x72011f792b787bdb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201287.003020:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b000676ee00/0x72011f792b787bdb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788201287.003035:0:14453:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003226696s 00010000:00010000:2.0:1788201287.003040:0:14453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b000676ee00/0x72011f792b787bdb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201287.003048:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b000676ee00/0x72011f792b787bdb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201287.003055:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b000676ee00/0x72011f792b787bdb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201287.003061:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b000676ee00/0x72011f792b787bdb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201287.003067:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676ee00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:2.0:1788201287.003071:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b000676ee00/0x72011f792b787bdb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201287.003079:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b000676ee00/0x72011f792b787bdb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201287.003100:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b000676ee00/0x72011f792b787bdb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201287.003118:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201287.003194:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:3295:x1875064622502400:12345-0@lo:103:ldlm_bl.0 Request processed in 575us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201287.003202:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788201287.003228:0:14484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b000676ee00/0x72011f792b787bdb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201287.003236:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b000676ee00/0x72011f792b787bdb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201287.003243:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b000676ee00/0x72011f792b787bdb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201287.003658:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3295:1875064622502400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201287.015817:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+11:14450:x1875064622502144:12345-0@lo:253:mount.lustre.0 Request processed in 69294us (69402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201287.015833:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201287.016216:0:14450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14450:1875064622502144:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788201287.016234:0:14450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788201287.016238:0:14450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201287.016240:0:14450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201287.016241:0:14450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201287.016243:0:14450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201287.016244:0:14450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201287.016245:0:14450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201287.016246:0:14450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201287.016247:0:14450:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201287.016249:0:14450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201287.016250:0:14450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788201287.016269:0:14450:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788201287.022122:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201287.022608:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788201287.022870:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201287.023098:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788201287.023464:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201287.024007:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788201287.024885:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201287.025271:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788201287.025534:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201287.025750:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788201287.026661:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201287.026983:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788201287.050999:0:14450:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788201287.051551:0:14450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788201287.051866:0:14507:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788201287.051936:0:14507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788201287.054739:0:14450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788201287.054878:0:14450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788201287.055363:0:14450:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788201287.055371:0:14450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788201287.055502:0:14450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201287.057746:0:14507:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788201287.057828:0:14507:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788201287.057833:0:14507:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:3.0:1788201287.058219:0:14506:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788201287.058224:0:14506:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1788201287.058922:0:14450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788201287.059700:0:14450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788201287.059741:0:14450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788201287.061800:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1788201287.066622:0:14450:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788201287.092773:0:14450:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788201287.092810:0:14450:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb3aec1c93988 00100000:10000000:1.0:1788201287.092817:0:14450:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788201287.094572:0:14450:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788201287.094590:0:14450:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.114@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788201287.094604:0:14450:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788201287.094624:0:14450:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788201287.629544:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788201287.947829:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788201288.335863:0:14466:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788201288.335874:0:14466:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9aff0131b800 from 6 10000000:01000000:1.0:1788201288.335891:0:14466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201288.335949:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681000/0x72011f792b787be2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201288.335964:0:14466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0001681000/0x72011f792b787be2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201288.335978:0:14466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0001681000/0x72011f792b787be2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201288.336021:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622502528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201288.336120:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201288.336206:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000551a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201288.336278:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622502528 00000100:00100000:3.0:1788201288.336288:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622502528 00000100:00100000:3.0:1788201288.336361:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201288.336372:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+11:14466:x1875064622502528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201288.336389:0:14463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201288.336406:0:14463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0000030a00/0x72011f792b787be9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787be2 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201288.336434:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0000030a00/0x72011f792b787be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787be2 expref: 12 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201288.336445:0:14463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0000030a00/0x72011f792b787be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787be2 expref: 12 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201288.336455:0:14463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000030a00, rc 0) 00000100:00100000:3.0:1788201288.336500:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:14466:x1875064622502528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201288.336507:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201288.336716:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622502528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201288.336733:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0001681000/0x72011f792b787be2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787be9 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201288.336743:0:14466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0001681000/0x72011f792b787be2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787be9 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201288.336930:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622502656:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788201288.336980:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201288.337006:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000551a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201288.337169:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622502656 00000100:00100000:3.0:1788201288.337175:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622502656 00000100:00100000:3.0:1788201288.337206:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201288.337214:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:14466:x1875064622502656:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788201288.337231:0:14461:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788201288.337256:0:14461:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788201288.337259:0:14461:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788201288.337339:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:14466:x1875064622502656:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201288.337346:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201288.338596:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622502656:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788201288.338997:0:14466:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201288.339009:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001681000/0x72011f792b787be2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787be9 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201288.339042:0:14466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0001681000/0x72011f792b787be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787be9 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201288.651236:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788201288.973672:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788201289.675342:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201290.699906:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201291.124277:0:14750:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788201291.725503:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201292.043339:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201292.043347:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201292.043350:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201292.043353:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201292.043357:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201292.043361:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201292.043365:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b0026fef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201292.043377:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b0026fef800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788201292.043414:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b003b0ad180 x1875064622502912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201292.043472:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875064622502912:0@lo:38:kworker.0 00000100:00100000:2.0:1788201292.043544:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201292.043618:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622502912 00000100:00100000:2.0:1788201292.043625:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622502912 00000100:00100000:2.0:1788201292.043658:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201292.043667:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3291:x1875064622502912:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201292.043691:0:14470:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 371 last 0 00000020:00000080:2.0:1788201292.043732:0:14470:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x72011f792b787bf0 00000004:00100000:2.0:1788201292.043756:0:14470:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201292.043897:0:14470:0:(import.c:65:import_set_state_nolock()) ffff9b003f8e8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201292.043948:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875064622502912:12345-0@lo:38:kworker.0 Request processed in 280us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201292.043955:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788201292.043996:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b003b0ad180 x1875064622502912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201292.044010:0:3291:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788201292.044016:0:3291:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788201292.044021:0:3291:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788201292.044024:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b0026fef800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788201292.044030:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875064622502912:0@lo:38:kworker.0 00000100:00100000:1.0:1788201292.044815:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3295:1875064622502784:0@lo:400:kworker.0 00000100:00100000:1.0:1788201292.044861:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201292.044906:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622502784 00000100:00100000:1.0:1788201292.044911:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622502784 00000100:00100000:1.0:1788201292.044959:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201292.044966:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:3295:x1875064622502784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201292.045008:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:3295:x1875064622502784:12345-0@lo:400:kworker.0 Request processed in 42us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201292.045015:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201292.045053:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3295:1875064622502784:0@lo:400:kworker.0 00010000:00010000:2.0:1788201292.747522:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201293.772497:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201294.128581:0:14900:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3970aa60 20000000:00000080:0.0:1788201294.128602:0:14900:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b003c167400 uarg=0000000000000000 20000000:01000000:0.0:1788201294.128645:0:14900:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788201294.128652:0:14900:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788201294.128658:0:14900:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788201294.132246:0:14901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788201294.132382:0:14900:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788201294.144398:0:14900:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788201294.145223:0:14900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b000676f400/0x72011f792b787bf7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201294.145246:0:14900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0000031c00/0x72011f792b787bb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787bb1 expref: 11 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201294.145255:0:14900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b000676f400/0x72011f792b787bf7 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201294.145314:0:14900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0000031c00/0x72011f792b787bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b787bb1 expref: 11 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201294.145329:0:14900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0000031c00/0x72011f792b787bb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b787bb1 expref: 11 pid: 14461 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201294.145344:0:14900:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14900:1875064622503040:0@lo:104: 00000100:00100000:0.0:1788201294.145473:0:14900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201294.145523:0:14900:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00100b4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201294.147488:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622503040 00000100:00100000:2.0:1788201294.147501:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622503040 00000100:00100000:2.0:1788201294.147558:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201294.147567:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+3:14900:x1875064622503040:12345-0@lo:104: 00010000:00010000:2.0:1788201294.147583:0:14451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787bb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b787bb8 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201294.147666:0:14451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201294.147672:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+3:14900:x1875064622503040:12345-0@lo:104: Request processed in 107us (2199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201294.147679:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201294.148090:0:14900:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14900:1875064622503040:0@lo:104: 00010000:00010000:0.0:1788201294.148114:0:14900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b000676f400/0x72011f792b787bf7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201294.148295:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201294.148302:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787bb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b787bb8 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201294.148322:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676ec00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1788201294.148326:0:14457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787bb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b787bb8 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201294.148335:0:14457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787bb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b787bb8 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201294.148342:0:14457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787bb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b787bb8 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201294.148347:0:14457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201294.148560:0:14457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787bb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787bb8 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201294.148567:0:14457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201294.148588:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787bb1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787bb8 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201294.148595:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787bb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787bb8 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201294.148613:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201294.148615:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201294.148616:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201294.148658:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201294.148686:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3293:1875064622503168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201294.149617:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201294.149967:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622503168 00000100:00100000:1.0:1788201294.149976:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622503168 00010000:00010000:1.0:1788201294.150005:0:14454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0000031c00/0x72011f792b787bb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b787bb1 expref: 12 pid: 14461 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201294.150116:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201294.150127:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:3293:x1875064622503168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201294.150163:0:14454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201294.150169:0:14454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0000031c00/0x72011f792b787bb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b787bb1 expref: 12 pid: 14461 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201294.150271:0:14454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0000031c00/0x72011f792b787bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b787bb1 expref: 12 pid: 14461 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201294.150294:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0000031c00/0x72011f792b787bb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b787bb1 expref: 12 pid: 14461 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201294.150310:0:14454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b000676f400/0x72011f792b787bf7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201294.150318:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b000676f400/0x72011f792b787bf7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201294.150333:0:14454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b000676f400/0x72011f792b787bf7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201294.150339:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b000676f400/0x72011f792b787bf7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201294.150345:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b000676f400/0x72011f792b787bf7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201294.150352:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b000676f400/0x72011f792b787bf7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201294.150358:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f400 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201294.150362:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b000676f400/0x72011f792b787bf7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201294.150371:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b000676f400/0x72011f792b787bf7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201294.150402:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b000676f400/0x72011f792b787bf7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201294.150412:0:14454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201294.150471:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+11:3293:x1875064622503168:12345-0@lo:103:ldlm_bl.0 Request processed in 346us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201294.150479:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201294.150506:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3293:1875064622503168:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201294.150566:0:14900:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b000676f400/0x72011f792b787bf7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201294.150574:0:14900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b000676f400/0x72011f792b787bf7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201294.150580:0:14900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b000676f400/0x72011f792b787bf7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201294.796274:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788201295.499332:0:14466:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201295.499341:0:14466:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9aff0131b800 from 10 10000000:01000000:0.0:1788201295.499346:0:14466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201295.499390:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b000676f800/0x72011f792b787bfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201295.499402:0:14466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b000676f800/0x72011f792b787bfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201295.499439:0:14466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b000676f800/0x72011f792b787bfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201295.499467:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622503296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201295.499539:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201295.499620:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000727e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201295.499894:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622503296 00000100:00100000:1.0:1788201295.499902:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622503296 00000100:00100000:1.0:1788201295.499954:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201295.499964:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+11:14466:x1875064622503296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201295.499978:0:14463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201295.499994:0:14463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0001681400/0x72011f792b787c05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787bfe expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201295.500015:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0001681400/0x72011f792b787c05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787bfe expref: 12 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201295.500025:0:14463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0001681400/0x72011f792b787c05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787bfe expref: 12 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201295.500034:0:14463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0001681400, rc 0) 00000100:00100000:1.0:1788201295.500095:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:14466:x1875064622503296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201295.500102:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201295.500465:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622503296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201295.500480:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b000676f800/0x72011f792b787bfe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787c05 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201295.500489:0:14466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b000676f800/0x72011f792b787bfe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787c05 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201295.500545:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622503424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201295.500574:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201295.503168:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000727e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201295.503348:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622503424 00000100:00100000:1.0:1788201295.503358:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622503424 00000100:00100000:1.0:1788201295.503495:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201295.503518:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:14466:x1875064622503424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201295.503820:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:14466:x1875064622503424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (3244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201295.503827:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201295.503928:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622503424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201295.503978:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622503552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201295.504026:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201295.505066:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000727e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201295.505175:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622503552 00000100:00100000:1.0:1788201295.505181:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622503552 00000100:00100000:1.0:1788201295.505220:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201295.505230:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:14466:x1875064622503552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201295.505431:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:14466:x1875064622503552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201295.505437:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201295.505568:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622503552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201295.506579:0:14961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788201295.506749:0:14466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788201295.506771:0:14466:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201295.506781:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b000676f800/0x72011f792b787bfe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787c05 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201295.506793:0:14466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b000676f800/0x72011f792b787bfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787c05 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201295.819324:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201296.141361:0:3291:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201286/real 1788201286] req@ffff9b004052f100 x1875064622500224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201296 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201296.141390:0:3291:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b004052f100 x1875064622500224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201296 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201296.141400:0:3291:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201286/real 1788201286] req@ffff9b002722d880 x1875064622499968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201296 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201296.141411:0:3291:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b002722d880 x1875064622499968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201296 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201296.141436:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b000f3de800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201296.141450:0:3291:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788201296.141454:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622500224:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788201296.141460:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b00050c6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201296.141465:0:3291:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788201296.141467:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622499968:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788201296.141544:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201296.141548:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788201296.141550:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b00050c6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201296.141554:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 366 00000100:00080000:1.0:1788201296.141558:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201296.141564:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b00050c6000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788201296.141584:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b002722df80 x1875064622503808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201296.141598:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201296.141601:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788201296.141603:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b000f3de800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201296.141606:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 366 00000100:00080000:1.0:1788201296.141608:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201296.141612:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b000f3de800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788201296.141623:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b002722f480 x1875064622503936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201296.141661:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3293:1875064622503680:0@lo:400:kworker.0 00000100:00100000:1.0:1788201296.141727:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201296.141784:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201296.141792:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622504064:0@lo:400:kworker.0 00000100:00100000:1.0:1788201296.141820:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201296.141854:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622503680 00000100:00100000:1.0:1788201296.141861:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622503680 00000100:00100000:1.0:1788201296.141907:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201296.141916:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:3293:x1875064622503680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201296.141959:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:3293:x1875064622503680:12345-0@lo:400:kworker.0 Request processed in 46us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201296.141967:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201296.141999:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622504064 00000100:00100000:1.0:1788201296.142002:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622504064 00000100:00100000:1.0:1788201296.142025:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201296.142031:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622504064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201296.142082:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622504064:12345-0@lo:400:kworker.0 Request processed in 50us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201296.142088:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788201296.142122:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b002722c380 x1875064622504064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201296.142157:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622504064:0@lo:400:kworker.0 00000100:00100000:1.0:1788201296.142183:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3293:1875064622503680:0@lo:400:kworker.0 00000100:00100000:1.0:1788201296.142197:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622503808:0@lo:8:kworker.0 00000400:00000100:1.0:1788201296.142222:0:3291:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064622503808 offset 0 length 520: 4 00000100:00100000:1.0:1788201296.142235:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622503936:0@lo:8:kworker.0 00000400:00000100:1.0:1788201296.142275:0:3291:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064622503936 offset 0 length 520: 4 00010000:00010000:3.0:1788201296.843540:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201297.867406:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788201298.187940:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1788201298.739281:0:15149:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788201298.739285:0:15149:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788201298.739470:0:15149:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b0026f59000 00000020:01000004:0.0:1788201298.739495:0:15149:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788201298.739507:0:15149:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788201298.739519:0:15149:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b00056999c0) 00000020:00000080:0.0:1788201298.739536:0:15149:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788201298.764573:0:15149:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788201298.764902:0:15149:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788201298.765862:0:15149:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788201298.766107:0:15149:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788201298.766856:0:15149:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788201298.767373:0:15149:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 521: rc = 0 00100000:10000000:1.0:1788201298.767610:0:15149:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 521: rc = 0 00100000:10000000:1.0:1788201298.767708:0:15149:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 521: rc = 0 00100000:10000000:1.0:1788201298.771700:0:15149:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 770: rc = 0 00100000:10000000:1.0:1788201298.772045:0:15149:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 770: rc = 0 00100000:10000000:1.0:1788201298.772301:0:15149:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:1.0:1788201298.773692:0:15149:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:1.0:1788201298.773950:0:15149:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:1.0:1788201298.774335:0:15149:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 770: rc = 0 00000020:00000080:1.0:1788201298.774947:0:15149:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788201298.774960:0:15149:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788201298.774971:0:15149:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72011f792b787c13 00000020:01000004:1.0:1788201298.774979:0:15149:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788201298.774999:0:15149:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.114@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788201298.775002:0:15149:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788201298.775008:0:15149:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788201298.775011:0:15149:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788201298.775022:0:15149:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b00067e3380) 00000020:00000080:1.0:1788201298.775042:0:15149:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1788201298.777495:0:15149:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201298.777659:0:15149:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788201298.777670:0:15149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788201298.778939:0:15149:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788201298.778947:0:15149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788201298.779248:0:15149:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788201298.779255:0:15149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788201298.781125:0:15149:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201298.781325:0:15149:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788201298.781332:0:15149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788201298.783246:0:15149:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788201298.783257:0:15149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788201298.802297:0:15149:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201298.802596:0:15149:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788201298.802603:0:15149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788201298.803827:0:15149:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788201298.803837:0:15149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788201298.804659:0:15149:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788201298.804666:0:15149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788201298.806681:0:15149:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201298.806859:0:15149:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788201298.806865:0:15149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788201298.807628:0:15149:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788201298.807635:0:15149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788201298.846341:0:15149:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201298.846590:0:15149:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788201298.846596:0:15149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788201298.847869:0:15149:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788201298.847880:0:15149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788201298.848312:0:15149:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788201298.848335:0:15149:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788201298.848341:0:15149:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.114@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788201298.858911:0:15149:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788201298.858962:0:15149:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.114@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788201298.858966:0:15149:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788201298.858968:0:15149:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201298.858970:0:15149:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201298.858971:0:15149:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201298.858972:0:15149:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201298.858974:0:15149:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201298.858975:0:15149:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201298.858977:0:15149:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201298.858978:0:15149:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201298.858982:0:15149:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788201298.858984:0:15149:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201298.858985:0:15149:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201298.858990:0:15149:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201298.858991:0:15149:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201298.858992:0:15149:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201298.858993:0:15149:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201298.858994:0:15149:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201298.858995:0:15149:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201298.858996:0:15149:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201298.859024:0:15149:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788201298.859057:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622504192:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788201298.859171:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201298.859221:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00088c6240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201298.859306:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622504192 00000100:00100000:3.0:1788201298.859314:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622504192 00000100:00100000:3.0:1788201298.859478:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788201298.859489:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:15149:x1875064622504192:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788201298.859520:0:14463:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788201298.859523:0:14463:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788201298.859526:0:14463:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788201298.864175:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:15149:x1875064622504192:12345-0@lo:253:mount.lustre.0 Request processed in 4680us (5035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201298.864192:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201298.864337:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622504192:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788201298.864354:0:15149:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788201298.864357:0:15149:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788201298.864359:0:15149:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201298.864360:0:15149:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201298.864361:0:15149:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201298.864362:0:15149:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201298.864364:0:15149:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201298.864365:0:15149:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201298.864367:0:15149:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201298.864369:0:15149:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788201298.864389:0:15149:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b0026f59000 from lustre-OST0000 10000000:01000000:0.0:1788201298.864476:0:15149:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788201298.864478:0:15149:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788201298.864485:0:15149:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b00051499c0 local copy 00010000:00010000:0.0:1788201298.864495:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b787b09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787b10 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201298.864784:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622504320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201298.864823:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201298.864898:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010d5c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201298.864932:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622504320 00000100:00100000:1.0:1788201298.864938:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622504320 00000100:00100000:1.0:1788201298.865015:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201298.865023:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:15149:x1875064622504320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201298.865194:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:15149:x1875064622504320:12345-0@lo:501:mount.lustre.0 Request processed in 171us (370us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201298.865201:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788201298.865272:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622504320:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788201298.865293:0:15149:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788201298.865433:0:15149:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788201298.865440:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b787b09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787b10 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.865451:0:15149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b787b09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787b10 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201298.865470:0:15149:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b0026f59000 10000000:01000000:0.0:1788201298.865474:0:15149:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788201298.865478:0:15149:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b00051499c0 10000000:01000000:0.0:1788201298.865481:0:15149:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788201298.865484:0:15149:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9b00051499c0 from 1 10000000:01000000:0.0:1788201298.865486:0:15149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788201298.865509:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b000676e600/0x72011f792b787c21 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.865517:0:15149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b000676e600/0x72011f792b787c21 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.865527:0:15149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b000676e600/0x72011f792b787c21 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201298.865539:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622504448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201298.865563:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201298.865816:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010d5c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201298.865873:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622504448 00000100:00100000:2.0:1788201298.865878:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622504448 00000100:00100000:2.0:1788201298.865901:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788201298.865907:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+12:15149:x1875064622504448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201298.865916:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201298.865928:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b001f8f0800/0x72011f792b787c28 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787c21 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.865947:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b001f8f0800/0x72011f792b787c28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787c21 expref: 13 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.865957:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b001f8f0800/0x72011f792b787c28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787c21 expref: 13 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.865966:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0800, rc 0) 00000100:00100000:2.0:1788201298.866002:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+13:15149:x1875064622504448:12345-0@lo:101:mount.lustre.0 Request processed in 94us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201298.866007:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201298.866077:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622504448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201298.866088:0:15149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b000676e600/0x72011f792b787c21 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787c28 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.866103:0:15149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b000676e600/0x72011f792b787c21 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787c28 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201298.866117:0:15149:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788201298.866160:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b000676e600/0x72011f792b787c21 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787c28 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.866168:0:15149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b000676e600/0x72011f792b787c21 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787c28 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201298.866174:0:15149:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788201298.866177:0:15149:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201298.866180:0:15149:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788201298.866182:0:15149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788201298.866194:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b000676ea00/0x72011f792b787c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.866201:0:15149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b000676ea00/0x72011f792b787c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.866209:0:15149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b000676ea00/0x72011f792b787c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201298.866219:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622504576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201298.866241:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201298.866256:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010d5c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201298.866305:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622504576 00000100:00100000:2.0:1788201298.866309:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622504576 00000100:00100000:2.0:1788201298.866324:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201298.866329:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+13:15149:x1875064622504576:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201298.866335:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201298.866342:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b001f8f0c00/0x72011f792b787c36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787c2f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.866360:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b001f8f0c00/0x72011f792b787c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787c2f expref: 14 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.866367:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b001f8f0c00/0x72011f792b787c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787c2f expref: 14 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.866374:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0c00, rc 0) 00000100:00100000:2.0:1788201298.866462:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+14:15149:x1875064622504576:12345-0@lo:101:mount.lustre.0 Request processed in 132us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201298.866468:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788201298.866530:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622504576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201298.866540:0:15149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b000676ea00/0x72011f792b787c2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787c36 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.866552:0:15149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b000676ea00/0x72011f792b787c2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787c36 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201298.867101:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788201298.868011:0:15149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201298.868619:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788201298.868668:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788201298.868775:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788201298.868828:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788201298.868883:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788201298.868916:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788201298.868981:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788201298.868989:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788201298.869079:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622504704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201298.869173:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201298.869385:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010d5cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201298.869485:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622504704 00000100:00100000:2.0:1788201298.869492:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622504704 00000100:00100000:2.0:1788201298.869574:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788201298.869585:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+14:15149:x1875064622504704:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201298.869974:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+14:15149:x1875064622504704:12345-0@lo:501:mount.lustre.0 Request processed in 390us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201298.869982:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201298.870060:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622504704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201298.870094:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622504832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201298.870129:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201298.870250:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010d5cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201298.870291:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622504832 00000100:00100000:1.0:1788201298.870296:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622504832 00000100:00100000:1.0:1788201298.870317:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201298.870324:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+14:15149:x1875064622504832:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201298.870796:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+14:15149:x1875064622504832:12345-0@lo:503:mount.lustre.0 Request processed in 470us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201298.870803:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788201298.870887:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622504832:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788201298.871916:0:15149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201298.871991:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622504960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201298.872053:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201298.872167:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010d5cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201298.872237:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622504960 00000100:00100000:1.0:1788201298.872242:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622504960 00000100:00100000:1.0:1788201298.872320:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201298.872329:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+14:15149:x1875064622504960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201298.872617:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+14:15149:x1875064622504960:12345-0@lo:502:mount.lustre.0 Request processed in 288us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201298.872625:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201298.872726:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622504960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201298.872975:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788201298.873025:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788201298.873074:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788201298.873123:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788201298.873192:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788201298.873227:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788201298.873275:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788201298.873310:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788201298.873343:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788201298.873388:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788201298.873451:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788201298.873498:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788201298.873528:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622505088:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201298.873574:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201298.874109:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010d5cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201298.874248:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622505088 00000100:00100000:3.0:1788201298.874256:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622505088 00000100:00100000:3.0:1788201298.874292:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201298.874301:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+14:15149:x1875064622505088:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201298.874617:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+14:15149:x1875064622505088:12345-0@lo:502:mount.lustre.0 Request processed in 316us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201298.874626:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788201298.874715:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622505088:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201298.874804:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788201298.874817:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788201298.875723:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201298.875731:0:15163:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788201298.875738:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201298.875740:0:15163:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788201298.875746:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201298.875760:0:15163:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b004093b380) 00000020:00000080:3.0:1788201298.875779:0:15163:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788201298.875786:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788201298.875850:0:15163:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b0026f59000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788201298.875858:0:15163:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788201298.875875:0:15163:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72011f792b787c44 00010000:00010000:3.0:1788201298.885384:0:15163:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788201298.885926:0:15163:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788201298.888084:0:15163:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788201298.890044:0:15163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788201298.890056:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201298.890063:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201298.890065:0:15163:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788201298.890068:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201298.890071:0:15163:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1788201298.890073:0:15163:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201298.890074:0:15163:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201298.890076:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201298.890078:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201298.890079:0:15163:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201298.890082:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201298.890085:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201298.890087:0:15163:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788201298.890089:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201298.890091:0:15163:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788201298.890094:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201298.890096:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201298.890097:0:15163:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788201298.890099:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201298.890102:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201298.890103:0:15163:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788201298.890106:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788201298.890183:0:15163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201298.890187:0:15163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201298.890188:0:15163:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788201298.890191:0:15163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788201298.890345:0:15149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788201298.890371:0:15149:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788201298.890400:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b000676ea00/0x72011f792b787c2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787c36 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.890412:0:15149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b000676ea00/0x72011f792b787c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787c36 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201298.890421:0:15149:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b0026f59000 from 1 10000000:01000000:0.0:1788201298.890424:0:15149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201298.890457:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b000676fc00/0x72011f792b787c4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.890475:0:15149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b000676fc00/0x72011f792b787c4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.890487:0:15149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b000676fc00/0x72011f792b787c4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201298.890511:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622505216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201298.890573:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201298.890617:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000551b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201298.890788:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622505216 00000100:00100000:3.0:1788201298.890795:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622505216 00000100:00100000:3.0:1788201298.890844:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201298.890860:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+14:15149:x1875064622505216:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201298.890876:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201298.890890:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0000030800/0x72011f792b787c52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787c4b expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.890911:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0000030800/0x72011f792b787c52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787c4b expref: 15 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.890921:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0000030800/0x72011f792b787c52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787c4b expref: 15 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.890929:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0000030800, rc 0) 00000100:00100000:3.0:1788201298.890969:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+15:15149:x1875064622505216:12345-0@lo:101:mount.lustre.0 Request processed in 110us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201298.890976:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788201298.891073:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622505216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201298.891086:0:15149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b000676fc00/0x72011f792b787c4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787c52 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.891094:0:15149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b000676fc00/0x72011f792b787c4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787c52 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.891906:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788201298.891929:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788201298.892576:0:15149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201298.893365:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788201298.893560:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788201298.893633:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788201298.893642:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788201298.893867:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622505344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201298.893925:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201298.893971:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000551b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201298.894064:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622505344 00000100:00100000:1.0:1788201298.894073:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622505344 00000100:00100000:1.0:1788201298.894123:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201298.894154:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+15:15149:x1875064622505344:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201298.894376:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+15:15149:x1875064622505344:12345-0@lo:501:mount.lustre.0 Request processed in 244us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201298.894384:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788201298.894584:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622505344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201298.894622:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622505472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201298.894670:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201298.894700:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000551b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201298.894786:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622505472 00000100:00100000:2.0:1788201298.894791:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622505472 00000100:00100000:2.0:1788201298.894817:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201298.894824:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:15149:x1875064622505472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201298.894991:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:15149:x1875064622505472:12345-0@lo:503:mount.lustre.0 Request processed in 167us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201298.894998:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788201298.895072:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622505472:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788201298.895632:0:15149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201298.895687:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622505600:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201298.895923:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201298.895981:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000551b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201298.898124:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622505600 00000100:00100000:2.0:1788201298.898159:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622505600 00000100:00100000:2.0:1788201298.898217:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201298.898226:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+15:15149:x1875064622505600:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201298.900841:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+15:15149:x1875064622505600:12345-0@lo:502:mount.lustre.0 Request processed in 2608us (4909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201298.900854:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788201298.901017:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622505600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201298.901460:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788201298.901529:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788201298.901579:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788201298.901632:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788201298.901668:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788201298.901802:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788201298.901840:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788201298.901874:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788201298.901914:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622505728:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201298.901981:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201298.902190:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000551b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201298.902542:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622505728 00000100:00100000:3.0:1788201298.902550:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622505728 00000100:00100000:1.0:1788201298.906267:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201298.906291:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+15:15149:x1875064622505728:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201298.907982:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+15:15149:x1875064622505728:12345-0@lo:502:mount.lustre.0 Request processed in 1692us (5991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201298.907996:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788201298.908253:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622505728:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201298.908563:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788201298.908580:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788201298.909644:0:15167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201298.909654:0:15167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201298.909656:0:15167:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788201298.909661:0:15167:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b0026f59000 00000020:00000080:0.0:1788201298.909663:0:15167:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201298.909678:0:15167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201298.909680:0:15167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201298.909681:0:15167:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788201298.909683:0:15167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201298.909686:0:15167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201298.909687:0:15167:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788201298.909690:0:15167:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b0026f59000 00000020:00000080:0.0:1788201298.909691:0:15167:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201298.910633:0:15167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201298.910640:0:15167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201298.910642:0:15167:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788201298.910646:0:15167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201298.910649:0:15167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201298.910650:0:15167:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788201298.910653:0:15167:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b0026f59000 00000020:00000080:0.0:1788201298.910655:0:15167:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201298.911275:0:15167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201298.911280:0:15167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201298.911282:0:15167:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788201298.911285:0:15167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788201298.911407:0:15149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788201298.911433:0:15149:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201298.911458:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b000676fc00/0x72011f792b787c4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787c52 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.911471:0:15149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b000676fc00/0x72011f792b787c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787c52 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201298.911529:0:15149:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788201298.911532:0:15149:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b0026f59000 10000000:01000000:1.0:1788201298.911535:0:15149:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b0026f59000 10000000:01000000:1.0:1788201298.911540:0:15149:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201298.911545:0:15149:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b0026f59000 from 1 10000000:01000000:1.0:1788201298.911548:0:15149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201298.911585:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001680e00/0x72011f792b787c59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.911598:0:15149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0001680e00/0x72011f792b787c59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.911608:0:15149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0001680e00/0x72011f792b787c59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201298.911633:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622505856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201298.911694:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.911934:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005f0b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201298.912556:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622505856 00000100:00100000:0.0:1788201298.912566:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622505856 00000100:00100000:0.0:1788201298.912651:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788201298.912661:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+15:15149:x1875064622505856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201298.912676:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201298.912691:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b000676e200/0x72011f792b787c60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787c59 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.912788:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b000676e200/0x72011f792b787c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787c59 expref: 16 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.912799:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b000676e200/0x72011f792b787c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787c59 expref: 16 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.912817:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676e200, rc 0) 00000100:00100000:0.0:1788201298.912879:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:15149:x1875064622505856:12345-0@lo:101:mount.lustre.0 Request processed in 220us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201298.912886:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788201298.912965:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622505856:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201298.912980:0:15149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0001680e00/0x72011f792b787c59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787c60 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.912989:0:15149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0001680e00/0x72011f792b787c59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787c60 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201298.913834:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788201298.914319:0:15149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201298.915190:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788201298.915251:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788201298.915286:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788201298.915350:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788201298.915914:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788201298.915973:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788201298.916040:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788201298.916081:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788201298.916156:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788201298.916192:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788201298.916221:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788201298.916281:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788201298.916624:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788201298.916664:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788201298.916783:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788201298.916823:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788201298.916855:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788201298.916903:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788201298.916939:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788201298.916972:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788201298.917017:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788201298.917065:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788201298.917114:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788201298.917198:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788201298.917236:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788201298.917267:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788201298.918642:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788201298.919872:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788201298.919972:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788201298.919981:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788201298.920100:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622505984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201298.921854:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201298.922187:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622505984 00000100:00100000:2.0:1788201298.922198:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622505984 00000100:00100000:2.0:1788201298.922252:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788201298.922262:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:15149:x1875064622505984:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201298.922464:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005f0b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201298.922706:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:15149:x1875064622505984:12345-0@lo:501:mount.lustre.0 Request processed in 444us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201298.922714:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788201298.922818:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622505984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201298.922867:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622506112:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201298.922909:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.922940:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005f0b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201298.923123:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622506112 00000100:00100000:1.0:1788201298.923128:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622506112 00000100:00100000:1.0:1788201298.923180:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201298.923188:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:15149:x1875064622506112:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201298.923335:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:15149:x1875064622506112:12345-0@lo:503:mount.lustre.0 Request processed in 147us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201298.923342:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201298.923396:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622506112:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788201298.923998:0:15149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201298.924083:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622506240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201298.924126:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.924177:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005f0b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201298.924616:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622506240 00000100:00100000:2.0:1788201298.924622:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622506240 00000100:00100000:2.0:1788201298.924651:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201298.924658:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:15149:x1875064622506240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201298.924854:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:15149:x1875064622506240:12345-0@lo:502:mount.lustre.0 Request processed in 195us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201298.924861:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788201298.926255:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622506240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201298.926904:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788201298.926970:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788201298.927003:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788201298.927068:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788201298.927107:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788201298.927187:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788201298.927239:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788201298.927272:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788201298.927331:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788201298.928873:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788201298.928949:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788201298.929019:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788201298.929069:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788201298.929102:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788201298.929168:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788201298.929207:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788201298.929239:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788201298.929285:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788201298.930559:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788201298.930622:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788201298.930679:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788201298.930712:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788201298.930765:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788201298.930814:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788201298.930847:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788201298.931559:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788201298.931680:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788201298.931719:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788201298.931752:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788201298.931897:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788201298.931945:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788201298.931978:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788201298.932013:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788201298.932080:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788201298.932118:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788201298.932207:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788201298.932246:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788201298.932278:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788201298.932485:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788201298.932526:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788201298.932599:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622506368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201298.932712:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.932774:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005f0b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201298.933882:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622506368 00000100:00100000:2.0:1788201298.933895:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622506368 00000100:00100000:2.0:1788201298.934852:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788201298.934870:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:15149:x1875064622506368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201298.935237:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:15149:x1875064622506368:12345-0@lo:502:mount.lustre.0 Request processed in 373us (2524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201298.935245:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201298.935590:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622506368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201298.935704:0:15149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788201298.935721:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788201298.943356:0:15172:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788201298.943385:0:15172:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b0010a499c0) 00000020:00000080:2.0:1788201298.943417:0:15172:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788201298.943581:0:15172:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b0026f59000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788201298.943585:0:15172:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b0026f59000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788201298.943587:0:15172:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b0026f59000 3 00010000:00080000:2.0:1788201298.943615:0:15172:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b001f80b800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.114@tcp at head 00010000:00010000:2.0:1788201298.947882:0:15172:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788201298.947992:0:15172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788201298.948043:0:15172:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788201298.948058:0:15172:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x72011f792b787c6e 00000100:00080000:2.0:1788201298.948068:0:15172:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201298.948075:0:15172:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b001f80b800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788201298.948120:0:15172:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b003b0ad180 x1875064622506496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201298.948161:0:15172:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788201298.948279:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1875064622506496:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201298.949117:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788201298.949490:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201298.949497:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201298.949500:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201298.949503:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788201298.949565:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201298.949577:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622506624:0@lo:400:kworker.0 00000100:00100000:0.0:1788201298.949628:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.949705:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622506496 00000100:00100000:1.0:1788201298.949713:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622506496 00000100:00100000:1.0:1788201298.949749:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622506624 00000100:00100000:1.0:1788201298.949752:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622506624 00000100:00100000:1.0:1788201298.949778:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201298.949787:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622506624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201298.949825:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201298.949834:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788201298.949849:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622506624:12345-0@lo:400:kworker.0 Request processed in 62us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201298.949858:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201298.949873:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201298.949876:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1875064622506496:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788201298.949898:0:14468:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 378 last 0 00000020:00000080:1.0:1788201298.949929:0:14468:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x72011f792b787c75 00000004:00100000:1.0:1788201298.949944:0:14468:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201298.949973:0:14468:0:(import.c:65:import_set_state_nolock()) ffff9b003f3aa800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201298.950042:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875064622506496:12345-0@lo:38:llog_process_th.0 Request processed in 163us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201298.950049:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788201298.950087:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b003b0ad180 x1875064622506496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788201298.950089:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b0035f85500 x1875064622506624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201298.950121:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201298.950128:0:3291:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788201298.950159:0:3291:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:1.0:1788201298.950163:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622506624:0@lo:400:kworker.0 00000100:00080000:0.0:1788201298.950166:0:3291:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788201298.950170:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b001f80b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201298.950177:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1875064622506496:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788201298.955261:0:15172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788201298.957075:0:15149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788201298.957117:0:15149:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201298.957160:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0001680e00/0x72011f792b787c59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787c60 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.957173:0:15149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0001680e00/0x72011f792b787c59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787c60 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788201298.957235:0:15149:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788201298.957238:0:15149:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201298.957239:0:15149:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201298.957240:0:15149:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201298.957241:0:15149:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201298.957242:0:15149:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201298.957243:0:15149:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201298.957245:0:15149:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201298.957246:0:15149:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201298.957249:0:15149:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788201298.957252:0:15149:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201298.957253:0:15149:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201298.957254:0:15149:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201298.957255:0:15149:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201298.957256:0:15149:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201298.957257:0:15149:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201298.957258:0:15149:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201298.957259:0:15149:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201298.957260:0:15149:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201298.957288:0:15149:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788201298.957307:0:15149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622506752:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201298.957388:0:15149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.957424:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622506752 00000100:00100000:1.0:1788201298.957436:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622506752 00000100:00100000:1.0:1788201298.957469:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788201298.957476:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:15149:x1875064622506752:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788201298.957500:0:14462:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788201298.957512:0:14462:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788201298.958087:0:15149:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005f0b780 going to sleep for 11 seconds 20000000:01000000:3.0:1788201298.984249:0:14462:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788201298.984268:0:14462:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788201298.984846:0:14484:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201298.984852:0:14484:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201298.984873:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0001680a00/0x72011f792b787c7c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.984892:0:14484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0000030a00/0x72011f792b787be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787be2 expref: 16 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.984901:0:14484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0001680a00/0x72011f792b787c7c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.984939:0:14484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0000030a00/0x72011f792b787be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b787be2 expref: 16 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.984951:0:14484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0000030a00/0x72011f792b787be9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b787be2 expref: 16 pid: 14463 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201298.984966:0:14484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14484:1875064622506880:0@lo:104: 00000100:00100000:1.0:1788201298.985034:0:14484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.985078:0:14484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00104f8000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201298.985364:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622506880 00000100:00100000:2.0:1788201298.985371:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622506880 00000100:00100000:2.0:1788201298.985420:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201298.985430:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+3:14484:x1875064622506880:12345-0@lo:104: 00010000:00010000:2.0:1788201298.985442:0:14451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b0001681000/0x72011f792b787be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b787be9 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.985499:0:14451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201298.985505:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+3:14484:x1875064622506880:12345-0@lo:104: Request processed in 78us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201298.985513:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788201298.985539:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201298.985557:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0001681000/0x72011f792b787be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b787be9 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.985564:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1788201298.985567:0:14457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0001681000/0x72011f792b787be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b787be9 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.985574:0:14457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0001681000/0x72011f792b787be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b787be9 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201298.985581:0:14457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0001681000/0x72011f792b787be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b787be9 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201298.985587:0:14457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201298.985621:0:14457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b0001681000/0x72011f792b787be2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787be9 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.985627:0:14457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201298.985645:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0001681000/0x72011f792b787be2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787be9 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.985652:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0001681000/0x72011f792b787be2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787be9 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.985666:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.985667:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.985669:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201298.986562:0:14484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14484:1875064622506880:0@lo:104: 00010000:00010000:3.0:1788201298.986586:0:14484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0001680a00/0x72011f792b787c7c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201298.986685:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3292:1875064622507008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201298.986733:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201298.986887:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622507008 00000100:00100000:3.0:1788201298.986893:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622507008 00010000:00010000:3.0:1788201298.986919:0:14455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0000030a00/0x72011f792b787be9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b787be2 expref: 17 pid: 14463 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201298.986971:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201298.986990:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+17:3292:x1875064622507008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201298.987001:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201298.987006:0:14455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0000030a00/0x72011f792b787be9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b787be2 expref: 17 pid: 14463 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.987016:0:14455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0000030a00/0x72011f792b787be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b787be2 expref: 17 pid: 14463 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.987039:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0000030a00/0x72011f792b787be9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b787be2 expref: 17 pid: 14463 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.987053:0:14455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0001680a00/0x72011f792b787c7c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.987060:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0001680a00/0x72011f792b787c7c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201298.987073:0:14455:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003226696s 00010000:00010000:3.0:1788201298.987077:0:14455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0001680a00/0x72011f792b787c7c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.987083:0:14455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0001680a00/0x72011f792b787c7c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.987090:0:14455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0001680a00/0x72011f792b787c7c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.987096:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0001680a00/0x72011f792b787c7c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.987102:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680a00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201298.987110:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0001680a00/0x72011f792b787c7c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.987118:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0001680a00/0x72011f792b787c7c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.987730:0:14484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0001680a00/0x72011f792b787c7c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.987751:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0001680a00/0x72011f792b787c7c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.987776:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0001680a00/0x72011f792b787c7c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.987784:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0001680a00/0x72011f792b787c7c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.987800:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201298.987876:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:3292:x1875064622507008:12345-0@lo:103:ldlm_bl.0 Request processed in 887us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201298.987883:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201298.990122:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+15:15149:x1875064622506752:12345-0@lo:253:mount.lustre.0 Request processed in 32637us (32725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201298.990165:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788201298.990293:0:15149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15149:1875064622506752:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201298.990309:0:15149:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788201298.990313:0:15149:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201298.990322:0:15149:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201298.990324:0:15149:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201298.990325:0:15149:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201298.990326:0:15149:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201298.990327:0:15149:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201298.990329:0:15149:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201298.990331:0:15149:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201298.990332:0:15149:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788201298.990350:0:15149:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788201298.994684:0:15149:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201298.994858:0:15149:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788201298.995008:0:15149:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201298.995700:0:15149:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788201298.995884:0:15149:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00000100:00100000:1.0:1788201298.996051:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3292:1875064622507008:0@lo:103:ldlm_bl.0 00080000:10000000:3.0:1788201298.996112:0:15149:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788201298.996884:0:15149:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788201299.035972:0:15149:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788201299.035983:0:15149:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788201299.036039:0:15149:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788201299.036113:0:15149:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.114@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788201299.036127:0:15149:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788201299.036182:0:15149:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788201299.917268:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788201300.619278:0:14466:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788201300.619286:0:14466:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9aff0131b800 from 7 10000000:01000000:0.0:1788201300.619292:0:14466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201300.619344:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b000676fa00/0x72011f792b787c83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201300.619358:0:14466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b000676fa00/0x72011f792b787c83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201300.619369:0:14466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b000676fa00/0x72011f792b787c83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201300.619396:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622507136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201300.619468:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201300.619552:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000a698840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201300.619759:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622507136 00000100:00100000:2.0:1788201300.619768:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622507136 00000100:00100000:2.0:1788201300.619825:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788201300.619835:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+15:14466:x1875064622507136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201300.619849:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201300.619864:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b001f8f1000/0x72011f792b787c8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787c83 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201300.619888:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b001f8f1000/0x72011f792b787c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787c83 expref: 16 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201300.619897:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b001f8f1000/0x72011f792b787c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787c83 expref: 16 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201300.619906:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1000, rc 0) 00000100:00100000:2.0:1788201300.619957:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:14466:x1875064622507136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201300.619963:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788201300.620067:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622507136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201300.620082:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b000676fa00/0x72011f792b787c83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787c8a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201300.620090:0:14466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b000676fa00/0x72011f792b787c83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787c8a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201300.620192:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622507264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788201300.620229:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201300.620253:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201300.620322:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622507264 00000100:00100000:1.0:1788201300.620327:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622507264 00000100:00100000:1.0:1788201300.620362:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788201300.620369:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:14466:x1875064622507264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788201300.620383:0:14462:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788201300.620401:0:14462:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201300.620404:0:14462:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788201300.620505:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:14466:x1875064622507264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201300.620512:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201300.620674:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622507264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788201300.620732:0:14466:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788201300.620739:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b000676fa00/0x72011f792b787c83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787c8a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201300.620748:0:14466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b000676fa00/0x72011f792b787c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787c8a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201300.946295:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201301.964035:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201302.988114:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201304.014378:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201304.335101:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201304.335107:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201304.335110:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201304.335112:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788201304.335218:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3293:1875064622507392:0@lo:400:kworker.0 00000100:00100000:0.0:1788201304.335293:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201304.335448:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622507392 00000100:00100000:2.0:1788201304.335455:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622507392 00000100:00100000:2.0:1788201304.335509:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201304.335519:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:3293:x1875064622507392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201304.335574:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:3293:x1875064622507392:12345-0@lo:400:kworker.0 Request processed in 56us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201304.335581:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201304.335718:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3293:1875064622507392:0@lo:400:kworker.0 00000100:00100000:0.0:1788201304.336191:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622507520:0@lo:400:kworker.0 00000100:00100000:0.0:1788201304.336231:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201304.336258:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201304.336265:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622507648:0@lo:400:kworker.0 00000100:00100000:0.0:1788201304.336286:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201304.337238:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622507520 00000100:00100000:2.0:1788201304.337248:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622507520 00000100:00100000:2.0:1788201304.337299:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622507648 00000100:00100000:2.0:1788201304.337303:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622507648 00000100:00100000:2.0:1788201304.337338:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201304.337347:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622507520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201304.337411:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622507520:12345-0@lo:400:kworker.0 Request processed in 65us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201304.337419:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201304.337434:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201304.337440:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622507648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201304.337469:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622507648:12345-0@lo:400:kworker.0 Request processed in 29us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201304.337488:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788201304.337520:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788201304.337557:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b003b0ac000 x1875064622507648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201304.337571:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622507648:0@lo:400:kworker.0 00010000:00080000:2.0:1788201304.337583:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b003b0af480 x1875064622507520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201304.337593:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622507520:0@lo:400:kworker.0 00010000:00010000:1.0:1788201305.037248:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201305.059041:0:15517:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788201306.061365:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201307.089516:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201308.107487:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788201308.428936:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788201309.131286:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201309.454464:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201309.454471:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201309.454474:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201309.454478:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788201309.454528:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622507904:0@lo:400:kworker.0 00000100:00100000:2.0:1788201309.454593:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201309.454662:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201309.454670:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3293:1875064622507776:0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.454689:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622508032:0@lo:400:kworker.0 00000100:00100000:2.0:1788201309.454702:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201309.454745:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622507904 00000100:00100000:3.0:1788201309.454750:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201309.454753:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622507904 00000100:00100000:2.0:1788201309.454799:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622508032 00000100:00100000:2.0:1788201309.454803:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622508032 00000100:00100000:2.0:1788201309.454855:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201309.454877:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622507904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201309.454946:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622507904:12345-0@lo:400:kworker.0 Request processed in 67us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201309.454963:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201309.454984:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201309.454992:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622508032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201309.455034:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622508032:12345-0@lo:400:kworker.0 Request processed in 43us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201309.455042:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201309.455051:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622507776 00000100:00100000:3.0:1788201309.455057:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622507776 00000100:00080000:2.0:1788201309.455064:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201309.455095:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788201309.455097:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b003b0ae300 x1875064622508032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201309.455107:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:3293:x1875064622507776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201309.455116:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622508032:0@lo:400:kworker.0 00000100:00100000:2.0:1788201309.455178:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3293:1875064622507776:0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.455180:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:3293:x1875064622507776:12345-0@lo:400:kworker.0 Request processed in 75us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201309.455191:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788201309.455196:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b003b0ac000 x1875064622507904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201309.455218:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622507904:0@lo:400:kworker.0 00010000:00010000:2.0:1788201310.155317:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201311.179883:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201311.180198:0:3291:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201296/real 1788201296] req@ffff9b002722df80 x1875064622503808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201311 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201311.180251:0:3291:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b002722df80 x1875064622503808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201311 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201311.180262:0:3291:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201296/real 1788201296] req@ffff9b002722f480 x1875064622503936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201311 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201311.180274:0:3291:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b002722f480 x1875064622503936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201311 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201311.180294:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b00050c6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201311.180324:0:3291:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788201311.180332:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622503808:0@lo:8:kworker.0 00000100:00080000:3.0:1788201311.180337:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b000f3de800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201311.180342:0:3291:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788201311.180345:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622503936:0@lo:8:kworker.0 00000100:00100000:3.0:1788201311.180607:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3295:1875064622508160:0@lo:400:kworker.0 00000100:00100000:3.0:1788201311.180691:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201311.180860:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622508160 00000100:00100000:0.0:1788201311.180874:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622508160 00000100:00100000:0.0:1788201311.180922:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788201311.180932:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:3295:x1875064622508160:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788201311.180933:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201311.180938:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788201311.180949:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b00050c6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201311.180957:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 375 00000100:00080000:2.0:1788201311.180963:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788201311.180976:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b00050c6000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788201311.180999:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b003b0af480 x1875064622508288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201311.181021:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201311.181025:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788201311.181026:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b000f3de800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201311.181029:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 375 00000100:00080000:2.0:1788201311.181032:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788201311.181035:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b000f3de800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788201311.181051:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b003b0ae300 x1875064622508416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201311.181101:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1875064622508672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201311.181163:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201311.181186:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201311.181191:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622508544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201311.181213:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201311.181239:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622508672 00000100:00100000:2.0:1788201311.181243:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622508672 00000100:00100000:2.0:1788201311.181276:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622508544 00000100:00100000:2.0:1788201311.181279:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622508544 00000100:00100000:2.0:1788201311.181298:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201311.181304:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875064622508672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201311.181348:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875064622508672:12345-0@lo:400:kworker.0 Request processed in 43us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.181355:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201311.181370:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201311.181383:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622508544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201311.181413:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622508544:12345-0@lo:400:kworker.0 Request processed in 31us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.181419:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788201311.181439:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788201311.181477:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b003b0adf80 x1875064622508544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201311.181490:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622508544:0@lo:400:kworker.0 00010000:00080000:2.0:1788201311.181500:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b003b0af800 x1875064622508672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201311.181508:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1875064622508672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201311.181528:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622508288:0@lo:8:kworker.0 00000100:00100000:2.0:1788201311.181556:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201311.181582:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622508416:0@lo:8:kworker.0 00000100:00100000:2.0:1788201311.181604:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201311.182552:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622508288 00000100:00100000:1.0:1788201311.182560:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622508288 00000100:00100000:1.0:1788201311.182580:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622508416 00000100:00100000:1.0:1788201311.182583:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622508416 00000100:00100000:1.0:1788201311.182594:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201311.182599:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3291:x1875064622508288:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788201311.182625:0:15150:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:1.0:1788201311.182936:0:15150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72011f792b787c91 00002000:00100000:1.0:1788201311.182964:0:15150:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b003f3ac000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788201311.182979:0:15150:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788201311.182982:0:15150:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788201311.183305:0:15150:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788201311.183391:0:15150:0:(import.c:65:import_set_state_nolock()) ffff9b003f3ab000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201311.183459:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3291:x1875064622508288:12345-0@lo:8:kworker.0 Request processed in 857us (1900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201311.183466:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201311.183482:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201311.183487:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3291:x1875064622508416:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788201311.183499:0:15150:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201311.183524:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3291:x1875064622508416:12345-0@lo:8:kworker.0 Request processed in 36us (1919us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201311.183530:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788201311.184801:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b003b0af480 x1875064622508288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201311.184814:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201311.184823:0:3291:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788201311.184831:0:3291:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788201311.184837:0:3291:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788201311.184839:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b00050c6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788201311.184870:0:3291:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788201311.184876:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622508288:0@lo:8:kworker.0 00000100:00080000:2.0:1788201311.184902:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b000f3de800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201311.184906:0:3291:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201311.184910:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622508416:0@lo:8:kworker.0 00000004:00080000:1.0:1788201311.185035:0:14491:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788201311.185057:0:14491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14491:1875064622508928:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788201311.185077:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:3295:x1875064622508160:12345-0@lo:400:kworker.0 Request processed in 4143us (4383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201311.185088:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201311.185100:0:14491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201311.185123:0:14491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003b29dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201311.185124:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622508800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201311.185160:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622508928 00000100:00100000:1.0:1788201311.185167:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622508928 00000100:00100000:2.0:1788201311.185184:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201311.185219:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201311.185228:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14491:x1875064622508928:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788201311.185236:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622508800 00000100:00100000:2.0:1788201311.185242:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622508800 00000004:00080000:0.0:1788201311.185253:0:14490:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788201311.185274:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201311.185283:0:15154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1875064622508800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201311.185309:0:15154:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201311.185352:0:15154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1875064622508800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.185358:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788201311.185378:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788201311.185401:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b002722ea00 x1875064622508800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201311.185416:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622508800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201311.185511:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3295:1875064622508160:0@lo:400:kworker.0 00000004:00080000:0.0:1788201311.185572:0:14490:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 390310436360ns, next at 0ns, rc = 0 00002000:00080000:1.0:1788201311.193176:0:15150:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788201311.193186:0:15150:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788201311.193191:0:15150:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1788201311.207095:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.207106:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025782d45/0x72011f792b787c98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.207131:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.207277:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.207284:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025782d45/0x72011f792b787c98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.207303:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025782d45/0x72011f792b787c98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.207387:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025782d45/0x72011f792b787c98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.207395:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025782d45/0x72011f792b787c98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.207414:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201311.207493:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201311.207499:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025782d45/0x72011f792b787c98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.207507:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681600 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201311.207512:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025782d45/0x72011f792b787c98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.207522:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025782d45/0x72011f792b787c98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.207679:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025782d45/0x72011f792b787c98 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.207689:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025782d45/0x72011f792b787c98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.207706:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.207708:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.207710:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201311.208391:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.208399:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004018b410/0x72011f792b787c9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.208409:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.208413:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.208966:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004018b410/0x72011f792b787c9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.208984:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004018b410/0x72011f792b787c9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.208994:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004018b410/0x72011f792b787c9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.209003:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004018b410/0x72011f792b787c9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.209032:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201311.209046:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201311.209050:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004018b410/0x72011f792b787c9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.209057:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681e00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201311.209061:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004018b410/0x72011f792b787c9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.209069:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004018b410/0x72011f792b787c9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.209083:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004018b410/0x72011f792b787c9f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.209090:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004018b410/0x72011f792b787c9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.209107:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.209109:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.209110:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201311.210095:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.210104:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000281c057b/0x72011f792b787ca6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.210116:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.210126:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.210152:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000281c057b/0x72011f792b787ca6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.210164:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000281c057b/0x72011f792b787ca6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.210172:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000281c057b/0x72011f792b787ca6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.210179:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000281c057b/0x72011f792b787ca6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.210195:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201311.210608:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1788201311.210612:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201311.210616:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000281c057b/0x72011f792b787ca6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.210619:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ec16656/0x72011f792b787cad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.210638:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681a00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201311.210640:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.210644:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201311.210645:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000281c057b/0x72011f792b787ca6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.210650:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ec16656/0x72011f792b787cad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.210665:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000281c057b/0x72011f792b787ca6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.210668:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ec16656/0x72011f792b787cad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.210688:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ec16656/0x72011f792b787cad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.210696:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000281c057b/0x72011f792b787ca6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.210712:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ec16656/0x72011f792b787cad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.210714:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000281c057b/0x72011f792b787ca6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.210745:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201311.210749:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201311.210749:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ec16656/0x72011f792b787cad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.210761:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001680a00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201311.210771:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ec16656/0x72011f792b787cad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.210780:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ec16656/0x72011f792b787cad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.210793:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ec16656/0x72011f792b787cad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.210796:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201311.210804:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ec16656/0x72011f792b787cad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.210823:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201311.210826:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201311.210829:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201311.211181:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.211187:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795d5738/0x72011f792b787cb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.211195:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.211199:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.211203:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000795d5738/0x72011f792b787cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.211211:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000795d5738/0x72011f792b787cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.211218:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000795d5738/0x72011f792b787cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.211224:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000795d5738/0x72011f792b787cb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.211238:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201311.211605:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.211611:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099c0627a/0x72011f792b787cbb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.211624:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.211627:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.211632:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099c0627a/0x72011f792b787cbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.211641:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099c0627a/0x72011f792b787cbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.211648:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099c0627a/0x72011f792b787cbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.211655:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099c0627a/0x72011f792b787cbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.211675:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201311.211833:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201311.211839:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000795d5738/0x72011f792b787cb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.211847:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681000 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201311.211850:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000795d5738/0x72011f792b787cb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.211865:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000795d5738/0x72011f792b787cb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.211879:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000795d5738/0x72011f792b787cb4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.211886:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000795d5738/0x72011f792b787cb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.211900:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201311.211903:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099c0627a/0x72011f792b787cbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.211909:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681200 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201311.211912:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099c0627a/0x72011f792b787cbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.211919:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099c0627a/0x72011f792b787cbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.211927:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099c0627a/0x72011f792b787cbb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.211933:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099c0627a/0x72011f792b787cbb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.211966:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201311.211968:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201311.211970:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201311.211975:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201311.213026:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.213035:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787cc2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.213046:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.213050:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.213055:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787cc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.213067:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787cc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.213088:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787cc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.213096:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787cc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.213113:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201311.213123:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201311.213127:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787cc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.214151:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0001681800 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201311.214157:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787cc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.214168:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787cc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.214185:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787cc2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.214193:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000838ea00f/0x72011f792b787cc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.214214:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.214223:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.214225:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201311.214758:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.214765:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787cc9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.214776:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.214781:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.214786:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787cc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.214796:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787cc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.214804:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787cc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.214812:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787cc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.214829:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201311.214838:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201311.214843:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787cc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.214850:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c076400 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201311.214854:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787cc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.214873:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787cc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.214885:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787cc9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.214893:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787cc9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.214907:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.214909:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.214910:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201311.215907:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.215916:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787cd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.215929:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.215932:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.215937:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787cd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.215960:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787cd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.215969:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787cd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.215981:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787cd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.215997:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201311.216007:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201311.216011:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787cd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.216018:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c076000 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201311.216021:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787cd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.216030:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787cd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.216043:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787cd0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.216049:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787cd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.216064:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.216066:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.216068:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201311.216498:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.216509:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787cd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.216517:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.216520:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.216524:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787cd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.216533:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787cd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.216541:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787cd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.216548:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787cd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.216563:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201311.216571:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201311.216576:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787cd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.216582:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c076200 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201311.216585:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787cd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.216593:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787cd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.216608:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787cd7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.216614:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787cd7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.216627:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.216629:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.216631:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201311.217536:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.217611:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043360231/0x72011f792b787cde lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.217624:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.217627:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.217632:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043360231/0x72011f792b787cde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.217643:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043360231/0x72011f792b787cde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.217652:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043360231/0x72011f792b787cde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.217660:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043360231/0x72011f792b787cde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.217733:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201311.218160:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.218166:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787ce5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.218174:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.218177:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.218181:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787ce5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.218189:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787ce5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.218196:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787ce5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.218203:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787ce5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.218273:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201311.218280:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043360231/0x72011f792b787cde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.218288:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c077c00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201311.218291:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043360231/0x72011f792b787cde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.218301:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043360231/0x72011f792b787cde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.218386:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043360231/0x72011f792b787cde lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.218404:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043360231/0x72011f792b787cde lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.218492:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201311.218497:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787ce5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.218503:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c076800 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201311.218506:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787ce5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.218512:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787ce5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.218523:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787ce5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.218530:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201311.218531:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201311.218533:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.218666:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788201311.218670:0:15150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787ce5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201311.219114:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.219120:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787cec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.219155:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.219159:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.219163:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787cec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.219174:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787cec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.219182:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787cec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.219189:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787cec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.219229:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201311.219235:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787cec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.219243:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c076c00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201311.219253:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787cec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.219261:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787cec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.219272:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787cec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.219280:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201311.219281:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201311.219283:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.220545:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788201311.220557:0:15150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787cec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201311.221568:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.221579:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787cf3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.221592:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.221597:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.221603:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787cf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.221630:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787cf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.221639:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787cf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.221647:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787cf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.221665:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201311.221678:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201311.221683:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787cf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.221690:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c077600 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201311.221694:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787cf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.221702:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787cf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.221716:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787cf3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.221723:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787cf3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.221750:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.221752:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.221754:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201311.222210:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201311.223079:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.223089:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a888061/0x72011f792b787cfa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.223101:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.223105:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.223111:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a888061/0x72011f792b787cfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.223122:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a888061/0x72011f792b787cfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.223131:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a888061/0x72011f792b787cfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.223173:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a888061/0x72011f792b787cfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.223192:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201311.223501:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201311.223509:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a888061/0x72011f792b787cfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.223520:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c077e00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201311.223524:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a888061/0x72011f792b787cfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.223533:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a888061/0x72011f792b787cfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.223619:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a888061/0x72011f792b787cfa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.223628:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a888061/0x72011f792b787cfa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.223656:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201311.223658:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201311.223661:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201311.223731:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.223737:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.223757:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.223761:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.223766:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.223776:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.223785:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.223793:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.223810:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201311.223820:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201311.223825:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.223832:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c077200 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201311.223835:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.223840:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.223861:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d01 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.223869:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.223884:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.223886:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.223890:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201311.227305:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201311.227317:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787d08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.227333:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1788201311.227339:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201311.227345:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787d08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.227359:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787d08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.227368:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787d08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.227376:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787d08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.227403:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201311.227746:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201311.227754:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787d08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.227764:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676ee00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201311.227769:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787d08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.227778:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787d08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.227795:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787d08 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.227802:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083eab710/0x72011f792b787d08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.227833:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.227835:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.227837:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201311.233320:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201311.233332:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787d0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.233361:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1788201311.233365:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201311.233372:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787d0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.233386:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787d0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.233396:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787d0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.233405:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787d0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.233795:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201311.236292:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201311.236376:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787d0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.236392:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f600 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:2.0:1788201311.236398:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787d0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.236421:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787d0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.236511:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787d0f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.236520:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003699b616/0x72011f792b787d0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.236542:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201311.236544:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201311.236546:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201311.236804:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201311.236814:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008419ff18/0x72011f792b787d16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.236826:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1788201311.236831:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201311.236838:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008419ff18/0x72011f792b787d16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.236851:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008419ff18/0x72011f792b787d16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.236872:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008419ff18/0x72011f792b787d16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.236881:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008419ff18/0x72011f792b787d16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201311.236909:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201311.241538:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201311.241555:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008419ff18/0x72011f792b787d16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.241569:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676e800 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:2.0:1788201311.241575:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008419ff18/0x72011f792b787d16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.241586:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008419ff18/0x72011f792b787d16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.241606:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008419ff18/0x72011f792b787d16 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.241626:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008419ff18/0x72011f792b787d16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.241645:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201311.241647:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201311.241648:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201311.244189:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.244202:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.244220:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.244226:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.244232:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.244246:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.244257:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.244265:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.244285:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201311.244296:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201311.244302:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.244321:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c077200 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201311.244325:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.244334:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.244350:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d1d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.244358:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0ca15d2/0x72011f792b787d1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.244383:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.244385:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.244386:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201311.246733:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.246746:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787d24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.246762:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.246766:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.246771:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787d24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.246799:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787d24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.246817:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787d24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.246825:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787d24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.246845:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201311.246857:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201311.246863:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787d24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.246870:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c077600 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201311.246874:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787d24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.246882:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787d24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.246898:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787d24 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.246905:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093c4f00a/0x72011f792b787d24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.246924:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.246933:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.246935:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201311.247413:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.247874:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787d2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.247885:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.247889:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.247893:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787d2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.247904:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787d2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.247912:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787d2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.247919:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787d2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.247934:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201311.247954:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201311.247959:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787d2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.247966:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c076c00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201311.247970:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787d2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.247989:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787d2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.248002:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787d2b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.248009:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c82bebd9/0x72011f792b787d2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.248024:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.248026:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.248027:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201311.248911:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.248919:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787d32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.248928:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.248931:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.248935:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787d32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.248955:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787d32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.248962:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787d32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.248980:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787d32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.249000:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201311.249027:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201311.249033:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787d32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.249041:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c076800 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:2.0:1788201311.249045:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787d32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.249054:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787d32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.249067:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787d32 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.249074:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000802c3ac0/0x72011f792b787d32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.249090:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201311.249091:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201311.249093:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201311.249666:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.249673:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787d39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.249682:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.249686:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.249690:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787d39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.249699:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787d39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.249707:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787d39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.249714:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787d39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.249760:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201311.250244:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.250250:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787d40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.250264:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.250267:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.250271:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787d40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.250293:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787d40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.250301:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787d40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.250309:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787d40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.250773:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201311.250781:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787d39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.250789:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c076200 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201311.250794:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787d39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.250803:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787d39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.250820:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787d39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.250827:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000964cc4a0/0x72011f792b787d39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.250843:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201311.250847:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787d40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.250852:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c076000 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201311.250870:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787d40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.250877:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787d40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.250886:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787d40 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.250894:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201311.250896:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201311.250898:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201311.251157:0:5849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788201311.251246:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788201311.251253:0:15150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a7ce12d/0x72011f792b787d40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201311.251792:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.251799:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787d47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.251809:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.251813:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.251818:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787d47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.251839:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787d47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.251848:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787d47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.251855:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787d47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.251889:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201311.251895:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787d47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.251902:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c076400 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201311.251906:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787d47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.251915:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787d47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.251928:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787d47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.251937:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201311.251955:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201311.251957:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201311.252015:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788201311.252020:0:15150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbfcf5f4/0x72011f792b787d47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.252915:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201311.253029:0:15150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201311.253036:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007580f226/0x72011f792b787d4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.253049:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788201311.253052:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201311.253057:0:15150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007580f226/0x72011f792b787d4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.253068:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007580f226/0x72011f792b787d4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.253087:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007580f226/0x72011f792b787d4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.253094:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007580f226/0x72011f792b787d4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.253117:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201311.253195:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201311.253202:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007580f226/0x72011f792b787d4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.253210:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c077400 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201311.253214:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007580f226/0x72011f792b787d4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.253223:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007580f226/0x72011f792b787d4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.253237:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007580f226/0x72011f792b787d4e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.253245:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007580f226/0x72011f792b787d4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.253262:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201311.253264:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201311.253265:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788201311.253796:0:15150:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1788201311.253899:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14491:x1875064622508928:12345-0@lo:5:osp-pre-0-0.0 Request processed in 68668us (68796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201311.253908:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201311.254066:0:14491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14491:1875064622508928:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788201311.254081:0:14491:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788201311.254196:0:14491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14491:1875064622509056:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788201311.254238:0:14491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201311.254296:0:14491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201311.255516:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622509056 00000100:00100000:1.0:1788201311.255526:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622509056 00000100:00100000:1.0:1788201311.255566:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201311.255575:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14491:x1875064622509056:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788201311.255616:0:15151:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1788201311.271625:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14491:x1875064622509056:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16045us (17380us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788201311.271641:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201311.271984:0:14491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14491:1875064622509056:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788201311.271998:0:14491:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000020:01000004:3.0:1788201311.320785:0:15869:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788201311.320789:0:15869:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788201311.320931:0:15869:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b003f5cc800 00000020:01000004:3.0:1788201311.321387:0:15869:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788201311.321402:0:15869:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788201311.321473:0:15869:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b0040938000) 00000020:00000080:3.0:1788201311.321493:0:15869:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788201311.353116:0:15869:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788201311.354828:0:15869:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788201311.355992:0:15869:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788201311.356238:0:15869:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788201311.357777:0:15869:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788201311.358405:0:15869:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 106: rc = 0 00100000:10000000:3.0:1788201311.358770:0:15869:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 106: rc = 0 00100000:10000000:3.0:1788201311.358869:0:15869:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 106: rc = 0 00100000:10000000:3.0:1788201311.359392:0:15869:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:3.0:1788201311.359981:0:15869:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1788201311.360311:0:15869:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1788201311.360809:0:15869:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1788201311.362273:0:15869:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:3.0:1788201311.362681:0:15869:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00000020:00000080:3.0:1788201311.363350:0:15869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788201311.363363:0:15869:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788201311.363374:0:15869:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72011f792b787d5c 00000020:01000004:3.0:1788201311.363381:0:15869:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788201311.363402:0:15869:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.114@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788201311.363405:0:15869:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788201311.363416:0:15869:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788201311.363579:0:15869:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788201311.363583:0:15869:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.114@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788201311.373057:0:15869:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788201311.373096:0:15869:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.114@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788201311.373100:0:15869:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788201311.373102:0:15869:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201311.373104:0:15869:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201311.373105:0:15869:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201311.373107:0:15869:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201311.373108:0:15869:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201311.373110:0:15869:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201311.373112:0:15869:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201311.373113:0:15869:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201311.373117:0:15869:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788201311.373119:0:15869:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201311.373121:0:15869:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201311.373122:0:15869:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201311.373123:0:15869:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201311.373124:0:15869:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201311.373126:0:15869:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201311.373127:0:15869:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201311.373128:0:15869:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201311.373129:0:15869:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201311.373354:0:15869:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788201311.373374:0:15869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622509184:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201311.373529:0:15869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201311.373632:0:15869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201311.373722:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622509184 00000100:00100000:0.0:1788201311.373730:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622509184 00000100:00100000:0.0:1788201311.373819:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788201311.373830:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:15869:x1875064622509184:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201311.373867:0:14463:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788201311.373871:0:14463:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788201311.373875:0:14463:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788201311.385106:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:15869:x1875064622509184:12345-0@lo:253:mount.lustre.0 Request processed in 11269us (11568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201311.385120:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201311.385224:0:15869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622509184:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201311.385241:0:15869:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788201311.385244:0:15869:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201311.385246:0:15869:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788201311.385248:0:15869:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201311.385249:0:15869:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201311.385251:0:15869:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201311.385252:0:15869:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201311.385254:0:15869:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201311.385256:0:15869:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201311.385257:0:15869:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788201311.385284:0:15869:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b003f5cc800 from lustre-OST0001 10000000:01000000:1.0:1788201311.385337:0:15869:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788201311.385341:0:15869:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788201311.385349:0:15869:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b00051499c0 local copy 00010000:00010000:1.0:1788201311.385360:0:15869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b787b09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787b10 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201311.386100:0:15869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622509312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201311.386165:0:15869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201311.386261:0:15869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00105e2180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201311.388913:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622509312 00000100:00100000:0.0:1788201311.388927:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622509312 00000100:00100000:0.0:1788201311.389053:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788201311.389065:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:15869:x1875064622509312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201311.389399:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:15869:x1875064622509312:12345-0@lo:501:mount.lustre.0 Request processed in 336us (3232us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201311.389408:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201311.389569:0:15869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622509312:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788201311.389601:0:15869:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788201311.389752:0:15869:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788201311.389762:0:15869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b787b09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787b10 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.389772:0:15869:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0000031800/0x72011f792b787b09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787b10 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201311.389809:0:15869:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b003f5cc800 10000000:01000000:1.0:1788201311.389814:0:15869:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788201311.389822:0:15869:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788201311.389824:0:15869:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201311.389828:0:15869:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788201311.389831:0:15869:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788201311.389860:0:15869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b003c076400/0x72011f792b787d63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.389868:0:15869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b003c076400/0x72011f792b787d63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.389890:0:15869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b003c076400/0x72011f792b787d63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201311.389910:0:15869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622509440:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201311.389955:0:15869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201311.390684:0:15869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00105e2180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201311.390771:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622509440 00000100:00100000:2.0:1788201311.390777:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622509440 00000100:00100000:2.0:1788201311.390813:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788201311.390822:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:15869:x1875064622509440:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201311.390834:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201311.390848:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b001f8f0400/0x72011f792b787d6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787d63 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.390871:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b001f8f0400/0x72011f792b787d6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787d63 expref: 17 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.390880:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b001f8f0400/0x72011f792b787d6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787d63 expref: 17 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.390889:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0400, rc 0) 00000100:00100000:2.0:1788201311.390936:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+17:15869:x1875064622509440:12345-0@lo:101:mount.lustre.0 Request processed in 115us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.390951:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788201311.391036:0:15869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622509440:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201311.391052:0:15869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b003c076400/0x72011f792b787d63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787d6a expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.391060:0:15869:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b003c076400/0x72011f792b787d63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787d6a expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201311.393642:0:15869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788201311.395212:0:15869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201311.395988:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788201311.396044:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788201311.396083:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788201311.396233:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788201311.396277:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788201311.396547:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788201311.396711:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788201311.396721:0:15869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788201311.396811:0:15869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622509568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201311.396877:0:15869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201311.396990:0:15869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00105e29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201311.397035:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622509568 00000100:00100000:2.0:1788201311.397042:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622509568 00000100:00100000:2.0:1788201311.397128:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788201311.397166:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+17:15869:x1875064622509568:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201311.397749:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+17:15869:x1875064622509568:12345-0@lo:501:mount.lustre.0 Request processed in 584us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.397765:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788201311.397866:0:15869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622509568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201311.397917:0:15869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622509696:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201311.397966:0:15869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201311.398566:0:15869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00105e29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201311.398648:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622509696 00000100:00100000:0.0:1788201311.398654:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622509696 00000100:00100000:0.0:1788201311.398684:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788201311.398692:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+17:15869:x1875064622509696:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201311.399016:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+17:15869:x1875064622509696:12345-0@lo:503:mount.lustre.0 Request processed in 323us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201311.399023:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201311.399191:0:15869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622509696:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788201311.400097:0:15869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201311.400199:0:15869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622509824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201311.400258:0:15869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201311.400288:0:15869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010d5c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201311.400414:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622509824 00000100:00100000:0.0:1788201311.400420:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622509824 00000100:00100000:0.0:1788201311.400510:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788201311.400518:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+17:15869:x1875064622509824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201311.400815:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+17:15869:x1875064622509824:12345-0@lo:502:mount.lustre.0 Request processed in 296us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201311.400822:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788201311.400916:0:15869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622509824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201311.401176:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788201311.401220:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788201311.401246:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788201311.401285:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788201311.401456:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788201311.401490:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788201311.401542:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788201311.401575:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788201311.401612:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788201311.401760:0:15869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622509952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201311.401806:0:15869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201311.401841:0:15869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010d5c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201311.401899:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622509952 00000100:00100000:2.0:1788201311.401906:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622509952 00000100:00100000:2.0:1788201311.401954:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788201311.401963:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+17:15869:x1875064622509952:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201311.402127:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+17:15869:x1875064622509952:12345-0@lo:502:mount.lustre.0 Request processed in 165us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.402151:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788201311.402253:0:15869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622509952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201311.402330:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788201311.402339:0:15869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788201311.403255:0:15870:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201311.403263:0:15870:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788201311.403276:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201311.403278:0:15870:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788201311.403283:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201311.403296:0:15870:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b000701cd40) 00000020:00000080:1.0:1788201311.403402:0:15870:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788201311.403409:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788201311.403537:0:15870:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b003f5cc800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788201311.403544:0:15870:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788201311.403551:0:15870:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72011f792b787d78 00010000:00010000:1.0:1788201311.410416:0:15870:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788201311.410976:0:15870:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788201311.413545:0:15870:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788201311.415020:0:15870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788201311.415033:0:15870:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201311.415039:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201311.415042:0:15870:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788201311.415045:0:15870:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201311.415050:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201311.415051:0:15870:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788201311.415054:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788201311.415056:0:15870:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788201311.415058:0:15870:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201311.415061:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201311.415062:0:15870:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788201311.415065:0:15870:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201311.415067:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201311.415068:0:15870:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788201311.415071:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788201311.415120:0:15870:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201311.415124:0:15870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201311.415125:0:15870:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788201311.415129:0:15870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788201311.415441:0:15869:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788201311.415469:0:15869:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788201311.415492:0:15869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b003c076400/0x72011f792b787d63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787d6a expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.415513:0:15869:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b003c076400/0x72011f792b787d63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787d6a expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201311.415521:0:15869:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b003f5cc800 from 1 10000000:01000000:3.0:1788201311.415524:0:15869:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201311.415559:0:15869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b787d7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.415566:0:15869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b787d7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.415577:0:15869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b787d7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201311.415602:0:15869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622510080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201311.415844:0:15869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201311.415888:0:15869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003fa6bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201311.415959:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622510080 00000100:00100000:2.0:1788201311.415968:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622510080 00000100:00100000:2.0:1788201311.416016:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788201311.416025:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+17:15869:x1875064622510080:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201311.416040:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201311.416054:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b001f8f1e00/0x72011f792b787d86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787d7f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.416076:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b001f8f1e00/0x72011f792b787d86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787d7f expref: 18 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.416085:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b001f8f1e00/0x72011f792b787d86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787d7f expref: 18 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.416093:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1e00, rc 0) 00000100:00100000:2.0:1788201311.416160:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+18:15869:x1875064622510080:12345-0@lo:101:mount.lustre.0 Request processed in 136us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.416168:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788201311.416345:0:15869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622510080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201311.416359:0:15869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b787d7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787d86 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.416369:0:15869:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b787d7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787d86 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201311.416997:0:15869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788201311.419908:0:15869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201311.421972:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788201311.422054:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788201311.422161:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788201311.422171:0:15869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788201311.422267:0:15869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622510208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201311.422340:0:15869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201311.422374:0:15869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010d5c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201311.422553:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622510208 00000100:00100000:3.0:1788201311.422560:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622510208 00000100:00100000:3.0:1788201311.422615:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788201311.422632:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+18:15869:x1875064622510208:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201311.422863:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+18:15869:x1875064622510208:12345-0@lo:501:mount.lustre.0 Request processed in 232us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201311.422872:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201311.423028:0:15869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622510208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201311.423063:0:15869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622510336:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201311.423099:0:15869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201311.423124:0:15869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010d5c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201311.423181:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622510336 00000100:00100000:0.0:1788201311.423186:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622510336 00000100:00100000:0.0:1788201311.423214:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788201311.423222:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+18:15869:x1875064622510336:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201311.423369:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+18:15869:x1875064622510336:12345-0@lo:503:mount.lustre.0 Request processed in 147us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201311.423376:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201311.423392:0:15869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622510336:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788201311.423970:0:15869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201311.424030:0:15869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622510464:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201311.424115:0:15869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201311.424255:0:15869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010d5c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201311.428734:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622510464 00000100:00100000:3.0:1788201311.428746:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622510464 00000100:00100000:3.0:1788201311.428848:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788201311.428860:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+18:15869:x1875064622510464:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201311.429155:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+18:15869:x1875064622510464:12345-0@lo:502:mount.lustre.0 Request processed in 297us (5039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201311.429163:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788201311.429266:0:15869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622510464:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201311.429765:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788201311.429822:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788201311.429873:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788201311.429911:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788201311.429958:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788201311.430025:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788201311.430063:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788201311.430098:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788201311.430155:0:15869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622510592:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201311.430205:0:15869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201311.430425:0:15869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0005124000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201311.430526:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622510592 00000100:00100000:1.0:1788201311.430532:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622510592 00000100:00100000:1.0:1788201311.430564:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201311.430571:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+18:15869:x1875064622510592:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201311.430873:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+18:15869:x1875064622510592:12345-0@lo:502:mount.lustre.0 Request processed in 300us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201311.430880:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788201311.430995:0:15869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622510592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201311.431084:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788201311.431095:0:15869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788201311.433238:0:15874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201311.433250:0:15874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201311.433253:0:15874:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788201311.433260:0:15874:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b003f5cc800 00000020:00000080:2.0:1788201311.433262:0:15874:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201311.433269:0:15874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201311.433271:0:15874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201311.433272:0:15874:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788201311.433275:0:15874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201311.433278:0:15874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201311.433278:0:15874:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788201311.433280:0:15874:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b003f5cc800 00000020:00000080:2.0:1788201311.433282:0:15874:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201311.434260:0:15874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201311.434270:0:15874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201311.434272:0:15874:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788201311.434275:0:15874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201311.434291:0:15874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201311.434293:0:15874:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788201311.434297:0:15874:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b003f5cc800 00000020:00000080:2.0:1788201311.434299:0:15874:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201311.436660:0:15874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201311.436671:0:15874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201311.436673:0:15874:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788201311.436677:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788201311.439722:0:15869:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788201311.439765:0:15869:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201311.440396:0:15869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b787d7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787d86 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.440411:0:15869:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b787d7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787d86 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201311.440501:0:15869:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788201311.440504:0:15869:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b003f5cc800 10000000:01000000:3.0:1788201311.440508:0:15869:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b003f5cc800 10000000:01000000:3.0:1788201311.440512:0:15869:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201311.440518:0:15869:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b003f5cc800 from 1 10000000:01000000:3.0:1788201311.440520:0:15869:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201311.440553:0:15869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000030a00/0x72011f792b787d8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.440561:0:15869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b0000030a00/0x72011f792b787d8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.440580:0:15869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b0000030a00/0x72011f792b787d8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201311.440603:0:15869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622510720:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201311.440667:0:15869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201311.440711:0:15869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0008b586c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201311.440729:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622510720 00000100:00100000:2.0:1788201311.440738:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622510720 00000100:00100000:2.0:1788201311.440788:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788201311.440798:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+18:15869:x1875064622510720:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201311.440810:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201311.440824:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b001f8f1c00/0x72011f792b787d94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787d8d expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.440850:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b001f8f1c00/0x72011f792b787d94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787d8d expref: 19 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.440860:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b001f8f1c00/0x72011f792b787d94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787d8d expref: 19 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.440869:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1c00, rc 0) 00000100:00100000:2.0:1788201311.440920:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:15869:x1875064622510720:12345-0@lo:101:mount.lustre.0 Request processed in 124us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.440927:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788201311.440977:0:15869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622510720:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201311.440991:0:15869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b0000030a00/0x72011f792b787d8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787d94 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.441000:0:15869:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b0000030a00/0x72011f792b787d8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787d94 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201311.447028:0:15869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788201311.447845:0:15869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201311.448368:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788201311.448560:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788201311.448618:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788201311.448701:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788201311.448750:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788201311.448968:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788201311.449016:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788201311.449048:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788201311.449102:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788201311.449799:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788201311.450002:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788201311.450064:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788201311.450094:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788201311.450121:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788201311.450210:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788201311.450246:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788201311.450273:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788201311.450316:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788201311.450370:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788201311.450400:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788201311.450459:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788201311.450499:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788201311.450535:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788201311.450582:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788201311.450619:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788201311.450656:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788201311.450717:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788201311.450762:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788201311.451364:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788201311.451539:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1788201311.451582:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1788201311.451618:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1788201311.451652:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1788201311.451700:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1788201311.451756:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1788201311.451985:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1788201311.452024:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1788201311.452118:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1788201311.452126:0:15869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788201311.452288:0:15869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622510848:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201311.452361:0:15869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201311.452417:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622510848 00000100:00100000:3.0:1788201311.453060:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622510848 00000100:00100000:3.0:1788201311.453120:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788201311.453128:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0002f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:15869:x1875064622510848:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201311.453362:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0002f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:15869:x1875064622510848:12345-0@lo:501:mount.lustre.0 Request processed in 234us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201311.453371:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788201311.453412:0:15869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0008b586c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201311.453509:0:15869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622510848:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201311.453545:0:15869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622510976:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201311.453590:0:15869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201311.453614:0:15869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0008b586c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201311.453775:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622510976 00000100:00100000:1.0:1788201311.453792:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622510976 00000100:00100000:1.0:1788201311.453816:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788201311.453822:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:15869:x1875064622510976:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201311.454062:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:15869:x1875064622510976:12345-0@lo:503:mount.lustre.0 Request processed in 239us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201311.454069:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788201311.454338:0:15869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622510976:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788201311.455024:0:15869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201311.455089:0:15869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622511104:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201311.455269:0:15869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201311.455340:0:15869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0008b586c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201311.456575:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622511104 00000100:00100000:1.0:1788201311.456585:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622511104 00000100:00100000:1.0:1788201311.456685:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201311.456697:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:15869:x1875064622511104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201311.457100:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:15869:x1875064622511104:12345-0@lo:502:mount.lustre.0 Request processed in 405us (1831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201311.457109:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201311.457646:0:15869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622511104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201311.458157:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788201311.458218:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788201311.458252:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788201311.458312:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788201311.458346:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788201311.458405:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788201311.458697:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788201311.458735:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788201311.459110:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788201311.459177:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788201311.459222:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788201311.459275:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788201311.459307:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788201311.459342:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788201311.459393:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788201311.459556:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788201311.459594:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788201311.459656:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788201311.459694:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788201311.459724:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788201311.459766:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788201311.459934:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788201311.459980:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788201311.460023:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788201311.460071:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788201311.460103:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788201311.460218:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788201311.460257:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788201311.460291:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788201311.460345:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788201311.460381:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788201311.460417:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788201311.460579:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788201311.460629:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788201311.460667:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788201311.460717:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788201311.460755:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788201311.460964:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788201311.461021:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788201311.461056:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788201311.461104:0:15869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622511232:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201311.461234:0:15869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201311.461324:0:15869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b000a698840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201311.461368:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622511232 00000100:00100000:2.0:1788201311.461375:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622511232 00000100:00100000:2.0:1788201311.461586:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788201311.461597:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:15869:x1875064622511232:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201311.461832:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:15869:x1875064622511232:12345-0@lo:502:mount.lustre.0 Request processed in 236us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.461839:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788201311.462039:0:15869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622511232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201311.462123:0:15869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788201311.462173:0:15869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788201311.464960:0:15879:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788201311.464977:0:15879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b004093cd40) 00000020:00000080:3.0:1788201311.465001:0:15879:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788201311.465184:0:15879:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b003f5cc800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788201311.465188:0:15879:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b003f5cc800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788201311.465191:0:15879:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b003f5cc800 3 00010000:00080000:3.0:1788201311.465222:0:15879:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b003f3aa000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.114@tcp at head 00010000:00010000:3.0:1788201311.466882:0:15879:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788201311.467012:0:15879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788201311.467045:0:15879:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788201311.467057:0:15879:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x72011f792b787da2 00000100:00080000:3.0:1788201311.467066:0:15879:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201311.467072:0:15879:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b003f3aa000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788201311.467108:0:15879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b004052df80 x1875064622511360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201311.467188:0:15879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788201311.468016:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1875064622511360:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201311.468086:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201311.468200:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622511360 00000100:00100000:2.0:1788201311.468207:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622511360 00000100:00100000:2.0:1788201311.468255:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201311.468263:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3291:x1875064622511360:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788201311.468289:0:15174:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 390 last 0 00000040:00080000:3.0:1788201311.468397:0:15879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:00000080:2.0:1788201311.468728:0:15174:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x72011f792b787da9 00000004:00100000:2.0:1788201311.468744:0:15174:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201311.468773:0:15174:0:(import.c:65:import_set_state_nolock()) ffff9b003f462000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201311.468841:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875064622511360:12345-0@lo:38:llog_process_th.0 Request processed in 576us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.468849:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788201311.469383:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b004052df80 x1875064622511360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201311.469395:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201311.469403:0:3291:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788201311.469410:0:3291:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788201311.469421:0:3291:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788201311.469424:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b003f3aa000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201311.469430:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1875064622511360:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788201311.469594:0:15869:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788201311.469625:0:15869:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201311.469714:0:15869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b0000030a00/0x72011f792b787d8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787d94 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.469724:0:15869:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b0000030a00/0x72011f792b787d8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787d94 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788201311.469771:0:15869:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788201311.469772:0:15869:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201311.469773:0:15869:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201311.469774:0:15869:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201311.469775:0:15869:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201311.469777:0:15869:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201311.469778:0:15869:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201311.469784:0:15869:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201311.469785:0:15869:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201311.469789:0:15869:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788201311.469791:0:15869:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201311.469792:0:15869:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201311.469792:0:15869:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201311.469793:0:15869:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201311.469794:0:15869:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201311.469795:0:15869:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201311.469796:0:15869:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201311.469797:0:15869:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201311.469797:0:15869:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201311.469816:0:15869:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788201311.469829:0:15869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622511488:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788201311.469871:0:15869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201311.469905:0:15869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00051249c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201311.469978:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622511488 00000100:00100000:0.0:1788201311.469984:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622511488 00000100:00100000:0.0:1788201311.470032:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788201311.470041:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:15869:x1875064622511488:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201311.470064:0:14461:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788201311.470077:0:14461:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788201311.497880:0:14461:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788201311.497900:0:14461:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788201311.497934:0:14484:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201311.497950:0:14484:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201311.497989:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b003c076000/0x72011f792b787db0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.498009:0:14484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b001f8f1000/0x72011f792b787c8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787c83 expref: 19 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.498018:0:14484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b003c076000/0x72011f792b787db0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.498058:0:14484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b001f8f1000/0x72011f792b787c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b787c83 expref: 19 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201311.498072:0:14484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b001f8f1000/0x72011f792b787c8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b787c83 expref: 19 pid: 14461 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201311.498088:0:14484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14484:1875064622511616:0@lo:104: 00000100:00100000:1.0:1788201311.498180:0:14484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201311.498237:0:14484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00100b4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201311.498312:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622511616 00000100:00100000:3.0:1788201311.498319:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622511616 00000100:00100000:3.0:1788201311.498377:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201311.498389:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+3:14484:x1875064622511616:12345-0@lo:104: 00010000:00010000:3.0:1788201311.498402:0:14452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b000676fa00/0x72011f792b787c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b787c8a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.498473:0:14452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201311.498480:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+3:14484:x1875064622511616:12345-0@lo:104: Request processed in 95us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201311.498487:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201311.498528:0:14484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14484:1875064622511616:0@lo:104: 00010000:00010000:2.0:1788201311.498542:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201311.498551:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b000676fa00/0x72011f792b787c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b787c8a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201311.498554:0:14484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b003c076000/0x72011f792b787db0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.498566:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676fa00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1788201311.498572:0:14457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b000676fa00/0x72011f792b787c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b787c8a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.498581:0:14457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b000676fa00/0x72011f792b787c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b787c8a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201311.498589:0:14457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b000676fa00/0x72011f792b787c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b787c8a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201311.498595:0:14457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201311.498633:0:14457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b000676fa00/0x72011f792b787c83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787c8a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.498651:0:14457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201311.498683:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b000676fa00/0x72011f792b787c83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787c8a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.498691:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b000676fa00/0x72011f792b787c83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787c8a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.498709:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201311.498710:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201311.498712:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201311.498768:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3295:1875064622511744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201311.498797:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201311.498903:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622511744 00000100:00100000:2.0:1788201311.498908:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622511744 00010000:00010000:2.0:1788201311.498927:0:14453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b001f8f1000/0x72011f792b787c8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b787c83 expref: 20 pid: 14461 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.498965:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201311.498973:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+20:3295:x1875064622511744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201311.498983:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201311.498989:0:14453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b001f8f1000/0x72011f792b787c8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b787c83 expref: 20 pid: 14461 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.499000:0:14453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b001f8f1000/0x72011f792b787c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b787c83 expref: 20 pid: 14461 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.499014:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b001f8f1000/0x72011f792b787c8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b787c83 expref: 20 pid: 14461 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.499026:0:14453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b003c076000/0x72011f792b787db0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.499045:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b003c076000/0x72011f792b787db0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788201311.499058:0:14453:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003226696s 00010000:00010000:2.0:1788201311.499063:0:14453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b003c076000/0x72011f792b787db0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.499069:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b003c076000/0x72011f792b787db0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.499076:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b003c076000/0x72011f792b787db0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.499083:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b003c076000/0x72011f792b787db0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.499088:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c076000 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:2.0:1788201311.499092:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b003c076000/0x72011f792b787db0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.499099:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b003c076000/0x72011f792b787db0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.499114:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b003c076000/0x72011f792b787db0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.499124:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201311.499186:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:3295:x1875064622511744:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.499193:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201311.499231:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3295:1875064622511744:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201311.499250:0:14484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b003c076000/0x72011f792b787db0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.499258:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b003c076000/0x72011f792b787db0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201311.499265:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b003c076000/0x72011f792b787db0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201311.521402:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+18:15869:x1875064622511488:12345-0@lo:253:mount.lustre.0 Request processed in 51353us (51521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.521419:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788201311.521650:0:15869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:15869:1875064622511488:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788201311.521665:0:15869:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788201311.521668:0:15869:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788201311.521670:0:15869:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788201311.521671:0:15869:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201311.521672:0:15869:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201311.521673:0:15869:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201311.521675:0:15869:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201311.521676:0:15869:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201311.521678:0:15869:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201311.521680:0:15869:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788201311.521693:0:15869:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788201311.529717:0:15869:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201311.529894:0:15869:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788201311.530070:0:15869:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201311.530558:0:15869:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788201311.530720:0:15869:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201311.530959:0:15869:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788201311.532725:0:15869:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788201311.623826:0:15869:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788201311.623837:0:15869:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788201311.624336:0:15869:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788201311.624416:0:15869:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.114@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788201311.624431:0:15869:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788201311.624463:0:15869:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788201312.205060:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201313.231289:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788201313.300218:0:14466:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788201313.300225:0:14466:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9aff0131b800 from 8 10000000:01000000:2.0:1788201313.300231:0:14466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201313.300277:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1400/0x72011f792b787db7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201313.300289:0:14466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1400/0x72011f792b787db7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201313.300309:0:14466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1400/0x72011f792b787db7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201313.300335:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622511872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201313.300401:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201313.300461:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f8753c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201313.300539:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622511872 00000100:00100000:0.0:1788201313.300549:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622511872 00000100:00100000:0.0:1788201313.300606:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788201313.300615:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+18:14466:x1875064622511872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201313.300639:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201313.300653:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b000676e400/0x72011f792b787dbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787db7 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201313.300677:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b000676e400/0x72011f792b787dbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787db7 expref: 19 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201313.300695:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b000676e400/0x72011f792b787dbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787db7 expref: 19 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201313.300704:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676e400, rc 0) 00000100:00100000:0.0:1788201313.300748:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:14466:x1875064622511872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201313.300755:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788201313.300854:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622511872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201313.300869:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1400/0x72011f792b787db7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787dbe expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201313.300878:0:14466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1400/0x72011f792b787db7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787dbe expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201313.300938:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622512000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788201313.300971:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201313.301003:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010941f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201313.301049:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622512000 00000100:00100000:0.0:1788201313.301054:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622512000 00000100:00100000:0.0:1788201313.301084:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788201313.301091:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:14466:x1875064622512000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788201313.301105:0:14461:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201313.301123:0:14461:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201313.301127:0:14461:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788201313.301222:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:14466:x1875064622512000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201313.301229:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788201313.301303:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622512000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788201313.301367:0:14466:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201313.301373:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1400/0x72011f792b787db7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787dbe expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201313.301381:0:14466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b001f8f1400/0x72011f792b787db7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787dbe expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201314.253824:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788201314.652053:0:6702:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788201314.652081:0:6702:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1788201315.280761:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201316.302145:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201316.622078:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201316.622104:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622512128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201316.622203:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201316.622373:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622512128 00000100:00100000:2.0:1788201316.622382:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622512128 00000100:00100000:2.0:1788201316.622433:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201316.622442:0:15154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622512128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201316.622476:0:15154:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201316.622517:0:15154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622512128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201316.622524:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788201316.622542:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201316.622563:0:3293:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788201316.622584:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622512128:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788201316.624597:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201316.624604:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788201316.624608:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b000f3de800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201316.624616:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 390 00000100:00080000:1.0:1788201316.624621:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788201316.624628:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b000f3de800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788201316.624648:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b002722ed80 x1875064622512384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201316.624714:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622512512:0@lo:400:kworker.0 00000100:00100000:1.0:1788201316.624770:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201316.624802:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201316.624807:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622512640:0@lo:400:kworker.0 00000100:00100000:1.0:1788201316.624825:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201316.624883:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3293:1875064622512256:0@lo:400:kworker.0 00000100:00100000:3.0:1788201316.624927:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201316.624961:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201316.624966:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622512768:0@lo:400:kworker.0 00000100:00100000:3.0:1788201316.624991:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201316.625054:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622512256 00000100:00100000:1.0:1788201316.625061:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622512256 00000100:00100000:1.0:1788201316.625108:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788201316.625117:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:3293:x1875064622512256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201316.625174:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:3293:x1875064622512256:12345-0@lo:400:kworker.0 Request processed in 59us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201316.625193:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788201316.625417:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3293:1875064622512256:0@lo:400:kworker.0 00000100:00100000:2.0:1788201316.625510:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622512512 00000100:00100000:2.0:1788201316.625514:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622512512 00000100:00100000:2.0:1788201316.625608:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622512640 00000100:00100000:2.0:1788201316.625612:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622512640 00000100:00100000:0.0:1788201316.625706:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622512384:0@lo:8:kworker.0 00000100:00100000:0.0:1788201316.625743:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201316.625822:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622512384 00000100:00100000:1.0:1788201316.625827:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622512384 00000100:00100000:1.0:1788201316.625847:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201316.625852:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3291:x1875064622512384:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788201316.625880:0:15150:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:1.0:1788201316.625919:0:15150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72011f792b787dc5 00002000:00100000:1.0:1788201316.625933:0:15150:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9aff018a0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788201316.625938:0:15150:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788201316.625941:0:15150:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788201316.626292:0:15150:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788201316.626314:0:15150:0:(import.c:65:import_set_state_nolock()) ffff9aff018a2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201316.626362:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3291:x1875064622512384:12345-0@lo:8:kworker.0 Request processed in 508us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201316.626369:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201316.626611:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622512768 00000100:00100000:3.0:1788201316.626617:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622512768 00000100:00100000:3.0:1788201316.626645:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201316.626653:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622512512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201316.626706:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875064622512512:12345-0@lo:400:kworker.0 Request processed in 54us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201316.626713:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201316.626726:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201316.626733:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622512640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201316.626761:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622512640:12345-0@lo:400:kworker.0 Request processed in 29us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201316.626767:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201316.626778:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201316.626784:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622512768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201316.626814:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875064622512768:12345-0@lo:400:kworker.0 Request processed in 31us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201316.626820:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788201316.626865:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b002722e680 x1875064622512768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201316.626878:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1875064622512768:0@lo:400:kworker.0 00010000:00080000:1.0:1788201316.626978:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b002722d180 x1875064622512640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201316.626988:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622512640:0@lo:400:kworker.0 00010000:00080000:1.0:1788201316.626999:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b002722ce00 x1875064622512512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201316.627007:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875064622512512:0@lo:400:kworker.0 00000100:00080000:2.0:1788201316.627122:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788201316.628941:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b002722ed80 x1875064622512384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201316.628955:0:3291:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201316.628964:0:3291:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788201316.628973:0:3291:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788201316.628979:0:3291:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788201316.628982:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9b000f3de800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788201316.629015:0:3291:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788201316.629023:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1875064622512384:0@lo:8:kworker.0 00000004:00080000:0.0:1788201316.629060:0:14492:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788201316.629503:0:14492:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 395754368455ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788201316.629959:0:14493:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788201316.629981:0:14493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14493:1875064622513024:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788201316.630041:0:14493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201316.630080:0:14493:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0008b586c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201316.631019:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622512896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201316.631057:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201316.631164:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622512896 00000100:00100000:1.0:1788201316.631172:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622512896 00000100:00100000:1.0:1788201316.631215:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201316.631222:0:15154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1875064622512896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201316.631252:0:15154:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201316.631289:0:15154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1875064622512896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201316.631296:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788201316.631361:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788201316.631388:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b002722ce00 x1875064622512896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201316.631405:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622512896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201316.631498:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622513024 00000100:00100000:3.0:1788201316.631502:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622513024 00000100:00100000:3.0:1788201316.631533:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201316.631539:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14493:x1875064622513024:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788201316.633790:0:15151:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788201316.633799:0:15151:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788201316.633804:0:15151:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1788201316.651804:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.651816:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b787dcc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.651834:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.651838:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.651845:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b787dcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.651863:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b787dcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.651874:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b787dcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.651882:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b787dcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.651926:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201316.652429:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.652435:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000279ca48e/0x72011f792b787dd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.652444:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.652448:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.652451:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000279ca48e/0x72011f792b787dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.652461:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000279ca48e/0x72011f792b787dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.652469:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000279ca48e/0x72011f792b787dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.652476:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000279ca48e/0x72011f792b787dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.652489:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788201316.652858:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.652864:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000356a00fa/0x72011f792b787dda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.652873:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.652881:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.652886:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000356a00fa/0x72011f792b787dda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.652895:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000356a00fa/0x72011f792b787dda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.652958:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201316.652965:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b787dcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.652974:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000030e00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:2.0:1788201316.652978:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b787dcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.652987:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b787dcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.653006:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b787dcc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.653014:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf61dccb/0x72011f792b787dcc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.653033:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201316.653037:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000279ca48e/0x72011f792b787dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.653043:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000031c00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:2.0:1788201316.653046:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000279ca48e/0x72011f792b787dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.653053:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000279ca48e/0x72011f792b787dd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.653071:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000279ca48e/0x72011f792b787dd3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.653077:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000279ca48e/0x72011f792b787dd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.653091:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201316.653092:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201316.653094:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.657055:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201316.657150:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000356a00fa/0x72011f792b787dda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.657169:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000356a00fa/0x72011f792b787dda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.657191:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201316.657784:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.657792:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b838611a/0x72011f792b787de1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.657805:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.657810:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.657817:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b838611a/0x72011f792b787de1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.657832:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b838611a/0x72011f792b787de1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.657840:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b838611a/0x72011f792b787de1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.657855:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b838611a/0x72011f792b787de1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.657867:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788201316.658293:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.658300:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc9840db/0x72011f792b787de8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.658308:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.658311:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.658315:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc9840db/0x72011f792b787de8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.658325:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc9840db/0x72011f792b787de8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.658333:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc9840db/0x72011f792b787de8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.658340:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc9840db/0x72011f792b787de8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.658349:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788201316.658724:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.658730:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ccd5161/0x72011f792b787def lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.658745:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.658748:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.658752:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ccd5161/0x72011f792b787def lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.658761:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ccd5161/0x72011f792b787def lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.658768:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ccd5161/0x72011f792b787def lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.658775:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ccd5161/0x72011f792b787def lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.658784:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788201316.659211:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.659217:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002aa4780d/0x72011f792b787df6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.659225:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.659229:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.659233:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002aa4780d/0x72011f792b787df6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.659242:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002aa4780d/0x72011f792b787df6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.659262:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002aa4780d/0x72011f792b787df6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.659270:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002aa4780d/0x72011f792b787df6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.659279:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788201316.659673:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.659679:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037c82caf/0x72011f792b787dfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.659689:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.659692:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.659697:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037c82caf/0x72011f792b787dfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.659706:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037c82caf/0x72011f792b787dfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.659715:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037c82caf/0x72011f792b787dfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.659722:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037c82caf/0x72011f792b787dfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.659741:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788201316.660130:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.660161:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ab84f25/0x72011f792b787e04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.660170:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.660172:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.660176:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ab84f25/0x72011f792b787e04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.660184:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ab84f25/0x72011f792b787e04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.660191:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ab84f25/0x72011f792b787e04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.660198:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ab84f25/0x72011f792b787e04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.660206:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788201316.660554:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.660560:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b63710/0x72011f792b787e0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.660567:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.660574:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.660578:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b63710/0x72011f792b787e0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.660586:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b63710/0x72011f792b787e0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.660594:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b63710/0x72011f792b787e0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.660600:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022b63710/0x72011f792b787e0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.660607:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:1.0:1788201316.661055:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788201316.661063:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000356a00fa/0x72011f792b787dda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661071:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6400 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201316.661076:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000356a00fa/0x72011f792b787dda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661085:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000356a00fa/0x72011f792b787dda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661104:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000356a00fa/0x72011f792b787dda lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661111:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000356a00fa/0x72011f792b787dda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661152:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788201316.661163:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b838611a/0x72011f792b787de1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661170:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7200 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201316.661174:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b838611a/0x72011f792b787de1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661181:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b838611a/0x72011f792b787de1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661191:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b838611a/0x72011f792b787de1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661198:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b838611a/0x72011f792b787de1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661210:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788201316.661214:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc9840db/0x72011f792b787de8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661220:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6e00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201316.661223:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc9840db/0x72011f792b787de8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661230:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc9840db/0x72011f792b787de8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661253:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc9840db/0x72011f792b787de8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661260:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc9840db/0x72011f792b787de8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661283:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788201316.661287:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ccd5161/0x72011f792b787def lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661293:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7800 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201316.661296:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ccd5161/0x72011f792b787def lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661304:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ccd5161/0x72011f792b787def lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661312:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ccd5161/0x72011f792b787def lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661319:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ccd5161/0x72011f792b787def lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661334:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788201316.661337:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002aa4780d/0x72011f792b787df6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661349:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7a00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201316.661352:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002aa4780d/0x72011f792b787df6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661359:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002aa4780d/0x72011f792b787df6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661368:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002aa4780d/0x72011f792b787df6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661374:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002aa4780d/0x72011f792b787df6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661388:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201316.661391:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037c82caf/0x72011f792b787dfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661397:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7e00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201316.661400:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037c82caf/0x72011f792b787dfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661407:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037c82caf/0x72011f792b787dfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661416:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037c82caf/0x72011f792b787dfd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661428:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037c82caf/0x72011f792b787dfd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661441:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201316.661444:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ab84f25/0x72011f792b787e04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661451:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7000 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201316.661454:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ab84f25/0x72011f792b787e04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661461:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ab84f25/0x72011f792b787e04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661472:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ab84f25/0x72011f792b787e04 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661479:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ab84f25/0x72011f792b787e04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661490:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201316.661493:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022b63710/0x72011f792b787e0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661499:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7600 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201316.661508:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b63710/0x72011f792b787e0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661516:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b63710/0x72011f792b787e0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661526:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022b63710/0x72011f792b787e0b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661533:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b63710/0x72011f792b787e0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.661545:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.661546:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.661548:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.661557:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201316.664500:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.664513:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000124e4c61/0x72011f792b787e12 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.664529:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.664534:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.664540:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000124e4c61/0x72011f792b787e12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.664553:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000124e4c61/0x72011f792b787e12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.664563:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000124e4c61/0x72011f792b787e12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.664576:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000124e4c61/0x72011f792b787e12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.664599:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201316.665083:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.665089:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025c3f513/0x72011f792b787e19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.665098:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.665101:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.665105:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025c3f513/0x72011f792b787e19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.665114:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025c3f513/0x72011f792b787e19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.665122:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025c3f513/0x72011f792b787e19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.665129:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025c3f513/0x72011f792b787e19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.665167:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201316.666408:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201316.666420:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000124e4c61/0x72011f792b787e12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.666433:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6600 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201316.666438:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000124e4c61/0x72011f792b787e12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.666449:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000124e4c61/0x72011f792b787e12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.666469:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000124e4c61/0x72011f792b787e12 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.666487:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000124e4c61/0x72011f792b787e12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.666512:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201316.666515:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025c3f513/0x72011f792b787e19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.666522:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6a00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201316.666525:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025c3f513/0x72011f792b787e19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.666533:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025c3f513/0x72011f792b787e19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.666543:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025c3f513/0x72011f792b787e19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.666551:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025c3f513/0x72011f792b787e19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.666563:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.666564:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.666566:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.666572:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201316.669479:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.669492:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ac7c6f3/0x72011f792b787e20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.669513:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.669517:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.669523:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ac7c6f3/0x72011f792b787e20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.669537:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ac7c6f3/0x72011f792b787e20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.669547:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ac7c6f3/0x72011f792b787e20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.669555:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ac7c6f3/0x72011f792b787e20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.669573:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201316.669980:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.669987:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b1af3d3/0x72011f792b787e27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.669995:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.669999:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.670003:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b1af3d3/0x72011f792b787e27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.670011:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b1af3d3/0x72011f792b787e27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.670028:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b1af3d3/0x72011f792b787e27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.670035:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b1af3d3/0x72011f792b787e27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.670048:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201316.670466:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201316.670474:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ac7c6f3/0x72011f792b787e20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.670490:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c7400 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201316.670495:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ac7c6f3/0x72011f792b787e20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.670504:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ac7c6f3/0x72011f792b787e20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.670521:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ac7c6f3/0x72011f792b787e20 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.670529:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ac7c6f3/0x72011f792b787e20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.670550:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201316.670554:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b1af3d3/0x72011f792b787e27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.670560:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b00029c6000 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201316.670563:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b1af3d3/0x72011f792b787e27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.670571:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b1af3d3/0x72011f792b787e27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.670580:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b1af3d3/0x72011f792b787e27 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.670594:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b1af3d3/0x72011f792b787e27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.670609:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.670611:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.670613:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.670620:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201316.672031:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.672043:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb104e7/0x72011f792b787e2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.672056:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.672060:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.672066:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feb104e7/0x72011f792b787e2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.672077:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feb104e7/0x72011f792b787e2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.672087:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb104e7/0x72011f792b787e2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.672094:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feb104e7/0x72011f792b787e2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.672128:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201316.673377:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201316.673389:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feb104e7/0x72011f792b787e2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.673401:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d2800 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201316.673406:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb104e7/0x72011f792b787e2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.673417:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb104e7/0x72011f792b787e2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.673438:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feb104e7/0x72011f792b787e2e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.673446:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feb104e7/0x72011f792b787e2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.673470:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.673472:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.673483:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201316.676830:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.676843:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c59dc445/0x72011f792b787e35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.676859:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.676864:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.676870:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c59dc445/0x72011f792b787e35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.676884:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c59dc445/0x72011f792b787e35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.676894:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c59dc445/0x72011f792b787e35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.676911:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c59dc445/0x72011f792b787e35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.676936:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201316.677502:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.677509:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecb90371/0x72011f792b787e3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.677518:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.677527:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.677531:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecb90371/0x72011f792b787e3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.677541:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecb90371/0x72011f792b787e3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.677550:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecb90371/0x72011f792b787e3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.677558:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecb90371/0x72011f792b787e3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.677573:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788201316.677965:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.677971:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b787e43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.677979:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.677982:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.677987:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b787e43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.677997:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b787e43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.678005:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b787e43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.678019:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b787e43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.678027:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788201316.678724:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.678730:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b787e4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.678739:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.678742:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.678745:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b787e4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.678754:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b787e4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.678761:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b787e4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.678768:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b787e4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.678776:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788201316.679209:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.679215:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eda12a0d/0x72011f792b787e51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.679229:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.679232:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.679237:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eda12a0d/0x72011f792b787e51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.679245:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eda12a0d/0x72011f792b787e51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.679253:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eda12a0d/0x72011f792b787e51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.679260:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eda12a0d/0x72011f792b787e51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679392:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788201316.679400:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c59dc445/0x72011f792b787e35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679408:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d2c00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201316.679412:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c59dc445/0x72011f792b787e35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679421:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c59dc445/0x72011f792b787e35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679436:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c59dc445/0x72011f792b787e35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679444:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c59dc445/0x72011f792b787e35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679463:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201316.679467:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecb90371/0x72011f792b787e3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679473:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d3600 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201316.679476:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecb90371/0x72011f792b787e3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679483:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecb90371/0x72011f792b787e3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679501:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecb90371/0x72011f792b787e3c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679507:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecb90371/0x72011f792b787e3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679520:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201316.679523:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b787e43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679529:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d3e00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201316.679532:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b787e43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679539:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b787e43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679548:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b787e43 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679554:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b787e43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679565:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201316.679568:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b787e4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679580:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d3200 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201316.679582:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b787e4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679590:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b787e4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679600:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b787e4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679606:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b787e4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.679619:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.679621:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.679622:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.679628:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201316.681581:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201316.682748:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201316.682759:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eda12a0d/0x72011f792b787e51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.682772:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d3400 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201316.682777:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eda12a0d/0x72011f792b787e51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.682788:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eda12a0d/0x72011f792b787e51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.682818:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eda12a0d/0x72011f792b787e51 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.682827:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eda12a0d/0x72011f792b787e51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.682848:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.682851:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.682852:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201316.684919:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.684931:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b787e58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.684946:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.684950:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.684956:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b787e58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.684969:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b787e58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.684988:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b787e58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.684995:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b787e58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.685021:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201316.686184:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201316.686195:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b787e58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.686207:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d3a00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201316.686212:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b787e58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.686222:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b787e58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.686242:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b787e58 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.686250:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b787e58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.686361:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201316.686363:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201316.686365:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201316.688356:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.688369:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007286049f/0x72011f792b787e5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.688384:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.688388:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.688394:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007286049f/0x72011f792b787e5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.688406:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007286049f/0x72011f792b787e5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.688416:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007286049f/0x72011f792b787e5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.688423:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007286049f/0x72011f792b787e5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.688448:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201316.688972:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.688978:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b787e66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.688987:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.688990:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.688994:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b787e66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.689004:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b787e66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.689012:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b787e66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.689019:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b787e66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.689033:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201316.689852:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201316.689861:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007286049f/0x72011f792b787e5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.689870:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d3000 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201316.689875:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007286049f/0x72011f792b787e5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.689884:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007286049f/0x72011f792b787e5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.689911:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007286049f/0x72011f792b787e5f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.689919:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007286049f/0x72011f792b787e5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.689937:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201316.689940:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b787e66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.689946:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d3800 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201316.689956:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b787e66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.689964:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b787e66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.689976:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b787e66 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.689983:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b787e66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.689995:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201316.689997:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201316.689998:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.691520:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201316.695339:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.695357:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b120043/0x72011f792b787e6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.695375:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.695385:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.695392:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b120043/0x72011f792b787e6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.695408:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b120043/0x72011f792b787e6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.695419:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b120043/0x72011f792b787e6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.695427:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b120043/0x72011f792b787e6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.695446:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201316.695459:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201316.695465:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b120043/0x72011f792b787e6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.695473:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d2e00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201316.695477:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b120043/0x72011f792b787e6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.695487:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b120043/0x72011f792b787e6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.695501:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b120043/0x72011f792b787e6d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.695520:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b120043/0x72011f792b787e6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.695536:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201316.695538:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201316.695540:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201316.696373:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.696381:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d87949c/0x72011f792b787e74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.696392:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.696396:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.696400:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d87949c/0x72011f792b787e74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.696410:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d87949c/0x72011f792b787e74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.696419:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d87949c/0x72011f792b787e74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.696426:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d87949c/0x72011f792b787e74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.696446:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201316.696836:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.696848:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd1dc03b/0x72011f792b787e7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.696856:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.696859:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.696863:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd1dc03b/0x72011f792b787e7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.696873:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd1dc03b/0x72011f792b787e7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.696881:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd1dc03b/0x72011f792b787e7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.696888:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd1dc03b/0x72011f792b787e7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.696914:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201316.696927:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201316.696933:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d87949c/0x72011f792b787e74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.696940:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d2600 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201316.696944:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d87949c/0x72011f792b787e74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.696952:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d87949c/0x72011f792b787e74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.696973:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d87949c/0x72011f792b787e74 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.696981:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d87949c/0x72011f792b787e74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.696996:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201316.697000:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd1dc03b/0x72011f792b787e7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.697005:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d2a00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201316.697009:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd1dc03b/0x72011f792b787e7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.697016:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd1dc03b/0x72011f792b787e7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.697025:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd1dc03b/0x72011f792b787e7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.697032:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd1dc03b/0x72011f792b787e7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.697042:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201316.697044:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201316.697051:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201316.697467:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.697473:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faa5bf3d/0x72011f792b787e82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.697482:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.697485:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.697490:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faa5bf3d/0x72011f792b787e82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.697500:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faa5bf3d/0x72011f792b787e82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.697508:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faa5bf3d/0x72011f792b787e82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.697515:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000faa5bf3d/0x72011f792b787e82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.697530:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201316.697539:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201316.697543:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000faa5bf3d/0x72011f792b787e82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.697550:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d2400 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201316.697554:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000faa5bf3d/0x72011f792b787e82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.697573:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000faa5bf3d/0x72011f792b787e82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.697585:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000faa5bf3d/0x72011f792b787e82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.697592:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faa5bf3d/0x72011f792b787e82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.697605:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201316.697607:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201316.697609:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201316.698004:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201316.698010:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d3c539f/0x72011f792b787e89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.698019:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788201316.698022:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201316.698026:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d3c539f/0x72011f792b787e89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.698034:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d3c539f/0x72011f792b787e89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.698041:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d3c539f/0x72011f792b787e89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.698059:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d3c539f/0x72011f792b787e89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.698073:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201316.698082:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201316.698086:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d3c539f/0x72011f792b787e89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.698093:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d2000 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201316.698096:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d3c539f/0x72011f792b787e89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.698104:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d3c539f/0x72011f792b787e89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.698115:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d3c539f/0x72011f792b787e89 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.698122:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d3c539f/0x72011f792b787e89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.698158:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201316.698160:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201316.698162:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788201316.698329:0:15151:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1788201316.698423:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14493:x1875064622513024:12345-0@lo:5:osp-pre-1-0.0 Request processed in 66879us (68377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201316.698438:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201316.698740:0:14493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14493:1875064622513024:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788201316.698755:0:14493:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788201316.698805:0:14493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14493:1875064622513152:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788201316.698837:0:14493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201316.698876:0:14493:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0033212300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201316.698899:0:15152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622513152 00000100:00100000:1.0:1788201316.698914:0:15152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622513152 00000100:00100000:1.0:1788201316.698948:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201316.698956:0:15152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14493:x1875064622513152:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788201316.698989:0:15152:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1788201316.705379:0:15152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14493:x1875064622513152:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6416us (6534us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788201316.705392:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788201316.705474:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201316.705650:0:14493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14493:1875064622513152:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788201316.705666:0:14493:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:2.0:1788201316.734381:0:5849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:02000400:0.0:1788201317.309340:0:16225:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788201317.324434:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201318.347957:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788201318.669201:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788201319.067969:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201319.068061:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614132992 00000100:00100000:2.0:1788201319.068079:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614132992 00000100:00100000:2.0:1788201319.068326:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 76 00000100:00100000:2.0:1788201319.068335:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2347:x1875064614132992:12345-192.168.203.14@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788201319.068364:0:14463:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from f6907c23-6974-4cbd-b040-4be99751a9b0@192.168.203.14@tcp t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:2.0:1788201319.068392:0:14463:0:(genops.c:1406:class_connect()) connect: client f6907c23-6974-4cbd-b040-4be99751a9b0, cookie 0x72011f792b787e90 00000100:00080000:2.0:1788201319.068550:0:14463:0:(import.c:65:import_set_state_nolock()) ffff9b003f463800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201319.068627:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+5:2347:x1875064614132992:12345-192.168.203.14@tcp:250:mount.lustre.0 Request processed in 291us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201319.068636:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 76 00000100:00100000:3.0:1788201319.079222:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201319.079308:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614133120 00000100:00100000:1.0:1788201319.079323:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614133120 00000100:00100000:1.0:1788201319.079408:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 77 00000100:00100000:1.0:1788201319.079420:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+5:13745:x1875064614133120:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788201319.079437:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201319.079456:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b003c076600/0x72011f792b787e97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d30fe expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.079485:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b003c076600/0x72011f792b787e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30fe expref: 6 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.079495:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b003c076600/0x72011f792b787e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d30fe expref: 6 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.079504:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b003c076600, rc 0) 00000100:00100000:1.0:1788201319.079576:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+6:13745:x1875064614133120:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 158us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201319.079583:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 77 00000100:00100000:3.0:1788201319.090869:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201319.092017:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614133248 00000100:00100000:2.0:1788201319.092051:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614133248 00000100:00100000:2.0:1788201319.092126:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 78 00000100:00100000:2.0:1788201319.092178:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+6:13745:x1875064614133248:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788201319.092531:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+6:13745:x1875064614133248:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 394us (1675us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201319.092540:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 78 00000100:00100000:3.0:1788201319.094247:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201319.100776:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614133376 00000100:00100000:0.0:1788201319.100797:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614133376 00000100:00100000:0.0:1788201319.100902:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 79 00000100:00100000:0.0:1788201319.100916:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6907c23-6974-4cbd-b040-4be99751a9b0+6:13745:x1875064614133376:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788201319.100948:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201319.100974:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b000676e000/0x72011f792b787e9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3105 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.101014:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b000676e000/0x72011f792b787e9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3105 expref: 7 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.101028:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b000676e000/0x72011f792b787e9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3105 expref: 7 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.101059:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676e000, rc 0) 00000100:00100000:0.0:1788201319.101177:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6907c23-6974-4cbd-b040-4be99751a9b0+7:13745:x1875064614133376:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 263us (6943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201319.101186:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 79 00000100:00100000:3.0:1788201319.106291:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201319.107279:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614133504 00000100:00100000:1.0:1788201319.107292:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614133504 00000100:00100000:1.0:1788201319.107349:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 80 00000100:00100000:1.0:1788201319.107357:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+7:13745:x1875064614133504:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788201319.107665:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+8:13745:x1875064614133504:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 303us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201319.107674:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 80 00000100:00100000:3.0:1788201319.110609:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201319.110927:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614133632 00000100:00100000:0.0:1788201319.110941:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614133632 00000100:00100000:0.0:1788201319.111014:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 81 00000100:00100000:0.0:1788201319.111027:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6907c23-6974-4cbd-b040-4be99751a9b0+8:13745:x1875064614133632:12345-192.168.203.14@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788201319.111981:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6907c23-6974-4cbd-b040-4be99751a9b0+8:13745:x1875064614133632:12345-192.168.203.14@tcp:503:mount.lustre.0 Request processed in 948us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201319.111996:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 81 00000100:00100000:3.0:1788201319.116214:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201319.116343:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614133760 00000100:00100000:2.0:1788201319.116360:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614133760 00000100:00100000:2.0:1788201319.116437:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 82 00000100:00100000:2.0:1788201319.116446:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+8:13764:x1875064614133760:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201319.116824:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+8:13764:x1875064614133760:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 377us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201319.116832:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 82 00000100:00100000:3.0:1788201319.132859:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201319.134367:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614133888 00000100:00100000:0.0:1788201319.134386:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614133888 00000100:00100000:1.0:1788201319.134601:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 83 00000100:00100000:1.0:1788201319.134624:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003a2fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6907c23-6974-4cbd-b040-4be99751a9b0+8:13764:x1875064614133888:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201319.134935:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003a2fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6907c23-6974-4cbd-b040-4be99751a9b0+8:13764:x1875064614133888:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 320us (2087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201319.134943:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 83 00000100:00100000:3.0:1788201319.138238:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201319.138559:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614134016 00000100:00100000:1.0:1788201319.138575:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614134016 00000100:00100000:1.0:1788201319.138709:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 84 00000100:00100000:1.0:1788201319.138721:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00331dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+8:13745:x1875064614134016:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788201319.138739:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201319.138758:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b003c076e00/0x72011f792b787ea5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d312f expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.138788:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b003c076e00/0x72011f792b787ea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d312f expref: 9 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.138801:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b003c076e00/0x72011f792b787ea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d312f expref: 9 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.138810:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b003c076e00, rc 0) 00000100:00100000:1.0:1788201319.138876:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00331dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+9:13745:x1875064614134016:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 158us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201319.138893:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 84 00000100:00100000:3.0:1788201319.145803:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201319.146107:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614134144 00000100:00100000:2.0:1788201319.146121:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614134144 00000100:00100000:2.0:1788201319.146270:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 85 00000100:00100000:2.0:1788201319.146283:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b00331ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+9:13745:x1875064614134144:12345-192.168.203.14@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788201319.146319:0:14463:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788201319.146352:0:14463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788201319.146356:0:14463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788201319.146360:0:14463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788201319.146362:0:14463:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788201319.148737:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b00331ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+9:13745:x1875064614134144:12345-192.168.203.14@tcp:256:mount.lustre.0 Request processed in 2441us (2934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201319.148756:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 85 00000100:00100000:3.0:1788201319.155829:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201319.158214:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614134272 00000100:00100000:1.0:1788201319.158235:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614134272 00000100:00100000:1.0:1788201319.158337:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 86 00000100:00100000:1.0:1788201319.158350:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+9:13745:x1875064614134272:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788201319.158373:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201319.158416:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b003c077800/0x72011f792b787eac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3136 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.158457:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b003c077800/0x72011f792b787eac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3136 expref: 10 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.158471:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b003c077800/0x72011f792b787eac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3136 expref: 10 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.158483:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b003c077800, rc 0) 00000100:00100000:1.0:1788201319.158582:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+10:13745:x1875064614134272:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 233us (2767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201319.158589:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 86 00000100:00100000:3.0:1788201319.161922:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201319.162051:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614134400 00000100:00100000:2.0:1788201319.162088:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614134400 00000100:00100000:2.0:1788201319.162195:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 87 00000100:00100000:2.0:1788201319.162207:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+10:13745:x1875064614134400:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788201319.162786:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+10:13745:x1875064614134400:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 579us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201319.162800:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 87 00000100:00100000:3.0:1788201319.166899:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201319.166948:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614134528 00000100:00100000:3.0:1788201319.166961:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614134528 00000100:00100000:3.0:1788201319.167026:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 88 00000100:00100000:3.0:1788201319.167040:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6907c23-6974-4cbd-b040-4be99751a9b0+10:13745:x1875064614134528:12345-192.168.203.14@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788201319.168295:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6907c23-6974-4cbd-b040-4be99751a9b0+10:13745:x1875064614134528:12345-192.168.203.14@tcp:503:mount.lustre.0 Request processed in 1249us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201319.168535:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 88 00000100:00100000:3.0:1788201319.176194:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201319.177014:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614134656 00000100:00100000:2.0:1788201319.177028:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614134656 00000100:00100000:2.0:1788201319.177107:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 89 00000100:00100000:2.0:1788201319.177118:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+10:13769:x1875064614134656:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201319.178023:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+10:13769:x1875064614134656:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 897us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201319.178037:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 89 00000100:00100000:1.0:1788201319.188833:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201319.188955:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614134784 00000100:00100000:3.0:1788201319.188970:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614134784 00000100:00100000:3.0:1788201319.189035:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 90 00000100:00100000:3.0:1788201319.189053:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6907c23-6974-4cbd-b040-4be99751a9b0+10:13769:x1875064614134784:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201319.189567:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6907c23-6974-4cbd-b040-4be99751a9b0+10:13769:x1875064614134784:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 518us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201319.189579:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 90 00000100:00100000:2.0:1788201319.201993:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201319.203328:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614134912 00000100:00100000:0.0:1788201319.203347:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614134912 00000100:00100000:0.0:1788201319.203475:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:0.0:1788201319.203486:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2347:x1875064614134912:12345-192.168.203.14@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788201319.203537:0:14468:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d@192.168.203.14@tcp t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:0.0:1788201319.203602:0:14468:0:(genops.c:1406:class_connect()) connect: client ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d, cookie 0x72011f792b787eb3 00000004:00100000:0.0:1788201319.203643:0:14468:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788201319.203650:0:14468:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788201319.237983:0:14468:0:(import.c:65:import_set_state_nolock()) ffff9b003f5e3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201319.238104:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:2347:x1875064614134912:12345-192.168.203.14@tcp:38:mount.lustre.0 Request processed in 34616us (36122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201319.238175:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:3.0:1788201319.241443:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201319.241622:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614135040 00000100:00100000:2.0:1788201319.241634:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614135040 00000100:00100000:2.0:1788201319.241743:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:2.0:1788201319.241755:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:0:x1875064614135040:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788201319.241812:0:15174:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788201319.241925:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:0:x1875064614135040:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 171us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201319.241934:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00080000:1.0:1788201319.242745:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201319.243852:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201319.243962:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614135168 00000100:00100000:1.0:1788201319.243973:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614135168 00000100:00100000:1.0:1788201319.244043:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:1.0:1788201319.244054:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:13745:x1875064614135168:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788201319.244093:0:14469:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788201319.244203:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:13745:x1875064614135168:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 151us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201319.244212:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:2.0:1788201319.248546:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201319.248713:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614135296 00000100:00100000:3.0:1788201319.248781:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614135296 00000100:00100000:3.0:1788201319.248859:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:3.0:1788201319.248871:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:13745:x1875064614135296:12345-192.168.203.14@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788201319.249006:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:13745:x1875064614135296:12345-192.168.203.14@tcp:40:mount.lustre.0 Request processed in 136us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201319.249014:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:0.0:1788201319.253459:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201319.253759:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201319.253804:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201319.253901:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614135680 00000100:00100000:2.0:1788201319.253914:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614135680 00000100:00100000:2.0:1788201319.254091:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:2.0:1788201319.254105:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:13745:x1875064614135680:12345-192.168.203.14@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788201319.255054:0:14471:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 817us 00000100:00100000:3.0:1788201319.256421:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614135424 00000100:00100000:1.0:1788201319.256422:0:15152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614135552 00000100:00100000:3.0:1788201319.256436:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614135424 00000100:00100000:1.0:1788201319.256436:0:15152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614135552 00000100:00100000:1.0:1788201319.256665:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:1.0:1788201319.256681:0:15152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875064614135552:12345-192.168.203.14@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788201319.256723:0:15152:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d@192.168.203.14@tcp t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:1.0:1788201319.256788:0:15152:0:(genops.c:1406:class_connect()) connect: client ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d, cookie 0x72011f792b787eba 00002000:00100000:1.0:1788201319.256805:0:15152:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d/ffff9b003fc2a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201319.256837:0:15152:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788201319.257116:0:15152:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788201319.257364:0:15152:0:(import.c:65:import_set_state_nolock()) ffff9b003fc28800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201319.257468:0:15152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:2347:x1875064614135552:12345-192.168.203.14@tcp:8:mount.lustre.0 Request processed in 788us (3661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201319.257479:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:1.0:1788201319.257513:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:1.0:1788201319.257644:0:15152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875064614135424:12345-192.168.203.14@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788201319.257668:0:15152:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d@192.168.203.14@tcp t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:1.0:1788201319.257699:0:15152:0:(genops.c:1406:class_connect()) connect: client ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d, cookie 0x72011f792b787ec1 00002000:00100000:1.0:1788201319.257708:0:15152:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d/ffff9b003fc29800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201319.257730:0:15152:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788201319.258361:0:15152:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788201319.258618:0:15152:0:(import.c:65:import_set_state_nolock()) ffff9b003fc2f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201319.258693:0:15152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:2347:x1875064614135424:12345-192.168.203.14@tcp:8:mount.lustre.0 Request processed in 1053us (5247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201319.258702:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00000004:00200000:3.0:1788201319.270272:0:14471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1788201319.270491:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:13745:x1875064614135680:12345-192.168.203.14@tcp:33:mount.lustre.0 Request processed in 16382us (16724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201319.270509:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00010000:00010000:2.0:1788201319.373744:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201319.449392:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201319.449565:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614135808 00000100:00100000:1.0:1788201319.449578:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614135808 00000100:00100000:1.0:1788201319.449665:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:1.0:1788201319.449677:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:13790:x1875064614135808:12345-192.168.203.14@tcp:101:mkdir.0 00010000:00010000:1.0:1788201319.449705:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201319.449759:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077200/0x72011f792b787ec8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3160 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.449923:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077600/0x72011f792b787ecf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.449941:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077600/0x72011f792b787ecf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.449961:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077600/0x72011f792b787ecf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201319.451319:0:14469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788201319.451330:0:14469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201319.451482:0:14469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077600/0x72011f792b787ecf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.451528:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077200/0x72011f792b787ec8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3160 expref: 8 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.451553:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077600/0x72011f792b787ecf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3160 expref: 7 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.451563:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0004dfd400) 00010000:00010000:0.0:1788201319.451566:0:14469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201319.451570:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b003c077600, rc 0) 00000100:00100000:0.0:1788201319.451672:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+7:13790:x1875064614135808:12345-192.168.203.14@tcp:101:mkdir.0 Request processed in 1996us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201319.451682:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00000001:00100000:3.0:1788201319.742283:0:6702:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d 00010000:00010000:0.0:1788201320.396726:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201321.296428:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201321.296649:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614135936 00000100:00100000:3.0:1788201321.296663:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614135936 00000100:00100000:3.0:1788201321.296763:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:3.0:1788201321.296776:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+7:13843:x1875064614135936:12345-192.168.203.14@tcp:41:lfs.0 00000004:00000024:3.0:1788201321.296841:0:15174:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788201321.296973:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+7:13843:x1875064614135936:12345-192.168.203.14@tcp:41:lfs.0 Request processed in 200us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201321.297029:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00080000:1.0:1788201321.297233:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201321.301056:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201321.301194:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614136064 00000100:00100000:1.0:1788201321.301208:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614136064 00000100:00100000:1.0:1788201321.301333:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:1.0:1788201321.301347:0:15154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+5:13843:x1875064614136064:12345-192.168.203.14@tcp:13:lfs.0 00002000:00000024:1.0:1788201321.301404:0:15154:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201321.301511:0:15154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+5:13843:x1875064614136064:12345-192.168.203.14@tcp:13:lfs.0 Request processed in 167us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201321.301520:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00080000:0.0:1788201321.301608:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201321.304481:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201321.304626:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614136192 00000100:00100000:2.0:1788201321.304638:0:15155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614136192 00000100:00100000:2.0:1788201321.304957:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:2.0:1788201321.304970:0:15155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:13843:x1875064614136192:12345-192.168.203.14@tcp:13:lfs.0 00002000:00000024:2.0:1788201321.305019:0:15155:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201321.305119:0:15155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:13843:x1875064614136192:12345-192.168.203.14@tcp:13:lfs.0 Request processed in 153us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201321.305128:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00080000:0.0:1788201321.307868:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788201321.420043:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201321.448257:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201321.448397:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614136320 00000100:00100000:3.0:1788201321.448424:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614136320 00000100:00100000:3.0:1788201321.448501:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 91 00000100:00100000:3.0:1788201321.448513:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+10:13874:x1875064614136320:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788201321.448536:0:14463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201321.448560:0:14463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aff030d2400/0x72011f792b787ed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3167 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201321.448598:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aff030d2400/0x72011f792b787ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3167 expref: 11 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201321.448610:0:14463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aff030d2400/0x72011f792b787ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3167 expref: 11 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201321.448622:0:14463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aff030d2400, rc 0) 00000100:00100000:3.0:1788201321.448699:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+11:13874:x1875064614136320:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 189us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201321.448707:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 91 00000100:00100000:3.0:1788201321.452074:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201321.452289:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614136448 00000100:00100000:2.0:1788201321.452303:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614136448 00000100:00100000:2.0:1788201321.452374:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 92 00000100:00100000:2.0:1788201321.452385:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6907c23-6974-4cbd-b040-4be99751a9b0+11:13874:x1875064614136448:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788201321.452844:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6907c23-6974-4cbd-b040-4be99751a9b0+11:13874:x1875064614136448:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 459us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201321.452853:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 92 00000100:00100000:0.0:1788201321.457820:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201321.458051:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614136576 00000100:00100000:1.0:1788201321.458066:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614136576 00000100:00100000:1.0:1788201321.458167:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 93 00000100:00100000:1.0:1788201321.458180:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+11:13874:x1875064614136576:12345-192.168.203.14@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788201321.458584:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+11:13874:x1875064614136576:12345-192.168.203.14@tcp:503:mount.lustre.0 Request processed in 405us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201321.458592:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 93 00000100:00100000:0.0:1788201321.461110:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201321.461518:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614136704 00000100:00100000:3.0:1788201321.461540:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614136704 00000100:00100000:3.0:1788201321.461611:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 94 00000100:00100000:3.0:1788201321.461623:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+11:13882:x1875064614136704:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788201321.462047:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+11:13882:x1875064614136704:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 424us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201321.462055:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 94 00000100:00100000:3.0:1788201321.489310:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201321.489430:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614136832 00000100:00100000:2.0:1788201321.489444:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614136832 00000100:00100000:2.0:1788201321.489523:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 95 00000100:00100000:2.0:1788201321.489536:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+11:13882:x1875064614136832:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201321.490262:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+11:13882:x1875064614136832:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 723us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201321.490274:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 95 00000100:00100000:0.0:1788201321.502961:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201321.503356:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614136960 00000100:00100000:1.0:1788201321.503369:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614136960 00000100:00100000:1.0:1788201321.503442:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 96 00000100:00100000:1.0:1788201321.503455:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+11:13874:x1875064614136960:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788201321.503479:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201321.503503:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b003c076c00/0x72011f792b787edd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3191 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201321.503540:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b003c076c00/0x72011f792b787edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3191 expref: 12 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201321.503554:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b003c076c00/0x72011f792b787edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3191 expref: 12 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201321.504394:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b003c076c00, rc 0) 00000100:00100000:1.0:1788201321.504498:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+12:13874:x1875064614136960:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 1042us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201321.504506:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 96 00000100:00100000:0.0:1788201321.507100:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201321.507277:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614137088 00000100:00100000:2.0:1788201321.507289:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614137088 00000100:00100000:2.0:1788201321.507466:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 97 00000100:00100000:2.0:1788201321.507479:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+12:13874:x1875064614137088:12345-192.168.203.14@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788201321.507514:0:14463:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788201321.507548:0:14463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788201321.507552:0:14463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788201321.507557:0:14463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788201321.507560:0:14463:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788201321.510575:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+12:13874:x1875064614137088:12345-192.168.203.14@tcp:256:mount.lustre.0 Request processed in 3084us (3474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201321.510593:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 97 00000100:00100000:0.0:1788201321.516974:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201321.517863:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614137216 00000100:00100000:1.0:1788201321.517887:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614137216 00000100:00100000:1.0:1788201321.517972:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 98 00000100:00100000:1.0:1788201321.517986:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+12:13874:x1875064614137216:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788201321.518016:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201321.518045:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b003c076000/0x72011f792b787ee4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3198 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201321.518088:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b003c076000/0x72011f792b787ee4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3198 expref: 13 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201321.518131:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b003c076000/0x72011f792b787ee4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3198 expref: 13 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201321.518166:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b003c076000, rc 0) 00000100:00100000:1.0:1788201321.518389:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+13:13874:x1875064614137216:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 405us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201321.518398:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 98 00000100:00100000:0.0:1788201321.521305:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201321.521709:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614137344 00000100:00100000:2.0:1788201321.521721:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614137344 00000100:00100000:2.0:1788201321.521914:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 99 00000100:00100000:2.0:1788201321.521927:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+13:13874:x1875064614137344:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788201321.522523:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+13:13874:x1875064614137344:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 447us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201321.522532:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 99 00000100:00100000:0.0:1788201321.529081:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201321.529218:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614137472 00000100:00100000:1.0:1788201321.529230:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614137472 00000100:00100000:1.0:1788201321.529405:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 100 00000100:00100000:1.0:1788201321.529421:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0026fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+13:13874:x1875064614137472:12345-192.168.203.14@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788201321.529778:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0026fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+13:13874:x1875064614137472:12345-192.168.203.14@tcp:503:mount.lustre.0 Request processed in 362us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201321.529788:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 100 00000100:00100000:0.0:1788201321.533496:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201321.534883:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614137600 00000100:00100000:2.0:1788201321.534903:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614137600 00000100:00100000:2.0:1788201321.535087:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 101 00000100:00100000:2.0:1788201321.535100:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+13:13886:x1875064614137600:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201321.535656:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+13:13886:x1875064614137600:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 555us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201321.535726:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 101 00000100:00100000:0.0:1788201321.540290:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201321.541633:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614137728 00000100:00100000:1.0:1788201321.541651:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614137728 00000100:00100000:1.0:1788201321.541749:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 102 00000100:00100000:1.0:1788201321.541762:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+13:13886:x1875064614137728:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201321.543072:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+13:13886:x1875064614137728:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 1303us (2788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201321.543086:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 102 00000100:00100000:0.0:1788201321.558190:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201321.558229:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201321.558255:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201321.558309:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201321.558396:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614137856 00000100:00100000:2.0:1788201321.558409:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614137856 00000100:00100000:2.0:1788201321.558462:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614138240 00000100:00100000:2.0:1788201321.558466:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614138240 00000100:00100000:2.0:1788201321.558506:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:2.0:1788201321.558518:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+7:2351:x1875064614138240:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201321.558623:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+7:2351:x1875064614138240:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 107us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201321.558632:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:2.0:1788201321.558655:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:2.0:1788201321.558660:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2347:x1875064614137856:12345-192.168.203.14@tcp:38:mount.lustre.0 00000100:00100000:3.0:1788201321.558684:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614138496 00010000:00080000:2.0:1788201321.558689:0:14468:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from dc130956-7593-4d7c-b6a5-5684b4485823@192.168.203.14@tcp t0 exp 0000000000000000 cur 400 last 0 00000100:00100000:3.0:1788201321.558704:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614138496 00000020:00000080:2.0:1788201321.558740:0:14468:0:(genops.c:1406:class_connect()) connect: client dc130956-7593-4d7c-b6a5-5684b4485823, cookie 0x72011f792b787eeb 00000100:00100000:3.0:1788201321.558752:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614138368 00000100:00100000:3.0:1788201321.558757:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614138368 00000100:00100000:3.0:1788201321.558776:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:3.0:1788201321.558783:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:2351:x1875064614138496:12345-192.168.203.14@tcp:400:kworker.0 00000004:00100000:2.0:1788201321.558784:0:14468:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788201321.558829:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:2351:x1875064614138496:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 45us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201321.558836:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:3.0:1788201321.558848:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:3.0:1788201321.558856:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+5:2351:x1875064614138368:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201321.558894:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+5:2351:x1875064614138368:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 39us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201321.558900:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00080000:2.0:1788201321.558981:0:14468:0:(import.c:65:import_set_state_nolock()) ffff9b001f80c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201321.559028:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc130956-7593-4d7c-b6a5-5684b4485823+6:2347:x1875064614137856:12345-192.168.203.14@tcp:38:mount.lustre.0 Request processed in 366us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201321.559035:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:0.0:1788201321.562776:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201321.563356:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614137984 00000100:00100000:3.0:1788201321.563371:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614137984 00000100:00100000:2.0:1788201321.564113:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:2.0:1788201321.564128:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc130956-7593-4d7c-b6a5-5684b4485823+6:0:x1875064614137984:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788201321.564192:0:15174:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1788201321.564536:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201321.564623:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc130956-7593-4d7c-b6a5-5684b4485823+6:0:x1875064614137984:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 497us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201321.564633:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:0.0:1788201321.565012:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201321.565383:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614138112 00000100:00100000:2.0:1788201321.565393:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614138112 00000100:00100000:2.0:1788201321.565439:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:2.0:1788201321.565448:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc130956-7593-4d7c-b6a5-5684b4485823+6:13874:x1875064614138112:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788201321.565476:0:14468:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788201321.565548:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc130956-7593-4d7c-b6a5-5684b4485823+6:13874:x1875064614138112:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 94us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201321.565556:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:2.0:1788201321.568422:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201321.568538:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614138624 00000100:00100000:3.0:1788201321.568620:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614138624 00000100:00100000:2.0:1788201321.568802:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:2.0:1788201321.568815:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dc130956-7593-4d7c-b6a5-5684b4485823+6:13874:x1875064614138624:12345-192.168.203.14@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788201321.568940:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dc130956-7593-4d7c-b6a5-5684b4485823+6:13874:x1875064614138624:12345-192.168.203.14@tcp:40:mount.lustre.0 Request processed in 127us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201321.568948:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:0.0:1788201321.580506:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201321.580557:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201321.580664:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201321.580728:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614139008 00000100:00100000:1.0:1788201321.580742:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614139008 00000100:00100000:1.0:1788201321.580813:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:1.0:1788201321.580841:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dc130956-7593-4d7c-b6a5-5684b4485823+6:13874:x1875064614139008:12345-192.168.203.14@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788201321.581184:0:14472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1788201321.581331:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dc130956-7593-4d7c-b6a5-5684b4485823+6:13874:x1875064614139008:12345-192.168.203.14@tcp:33:mount.lustre.0 Request processed in 492us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201321.581340:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:3.0:1788201321.583383:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614138752 00000100:00100000:3.0:1788201321.583465:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614138752 00000100:00100000:1.0:1788201321.583524:0:15152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614138880 00000100:00100000:1.0:1788201321.583529:0:15152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614138880 00000100:00100000:1.0:1788201321.583812:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:1.0:1788201321.583822:0:15152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875064614138880:12345-192.168.203.14@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788201321.583876:0:15152:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from dc130956-7593-4d7c-b6a5-5684b4485823@192.168.203.14@tcp t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:1.0:1788201321.583923:0:15152:0:(genops.c:1406:class_connect()) connect: client dc130956-7593-4d7c-b6a5-5684b4485823, cookie 0x72011f792b787ef2 00002000:00100000:1.0:1788201321.583937:0:15152:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dc130956-7593-4d7c-b6a5-5684b4485823/ffff9b003fc2e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201321.583951:0:15152:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788201321.584096:0:15152:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788201321.584170:0:15152:0:(import.c:65:import_set_state_nolock()) ffff9b003fc2c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201321.584272:0:15152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc130956-7593-4d7c-b6a5-5684b4485823+6:2347:x1875064614138880:12345-192.168.203.14@tcp:8:mount.lustre.0 Request processed in 449us (3606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201321.584282:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:2.0:1788201321.585605:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:2.0:1788201321.585627:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1875064614138752:12345-192.168.203.14@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788201321.585663:0:15150:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from dc130956-7593-4d7c-b6a5-5684b4485823@192.168.203.14@tcp t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:2.0:1788201321.585711:0:15150:0:(genops.c:1406:class_connect()) connect: client dc130956-7593-4d7c-b6a5-5684b4485823, cookie 0x72011f792b787ef9 00002000:00100000:2.0:1788201321.585740:0:15150:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dc130956-7593-4d7c-b6a5-5684b4485823/ffff9b001f80f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788201321.585754:0:15150:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788201321.586062:0:15150:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788201321.586100:0:15150:0:(import.c:65:import_set_state_nolock()) ffff9b003f5ce800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201321.586490:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dc130956-7593-4d7c-b6a5-5684b4485823+6:2347:x1875064614138752:12345-192.168.203.14@tcp:8:mount.lustre.0 Request processed in 870us (5929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201321.586501:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:3.0:1788201321.739512:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201321.739547:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622513280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201321.739662:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201321.739783:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622513280 00000100:00100000:3.0:1788201321.739792:0:15155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622513280 00000100:00080000:1.0:1788201321.740071:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201321.740098:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201321.740110:0:15154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622513280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201321.740166:0:15154:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201321.740218:0:15154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622513280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201321.740226:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201321.740299:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622513280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201321.740643:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622513792:0@lo:400:kworker.0 00000100:00100000:0.0:1788201321.740682:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201321.740704:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201321.740709:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3294:1875064622513408:0@lo:400:kworker.0 00000100:00100000:0.0:1788201321.740735:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201321.740757:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1875064622513920:0@lo:400:kworker.0 00000100:00100000:0.0:1788201321.740778:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201321.740783:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622513664:0@lo:400:kworker.0 00000100:00100000:0.0:1788201321.740809:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622513792 00000100:00100000:0.0:1788201321.740815:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622513792 00000100:00100000:3.0:1788201321.740829:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201321.740860:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201321.740861:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622513920 00000100:00100000:0.0:1788201321.740865:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622513920 00000100:00100000:0.0:1788201321.740891:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622513664 00000100:00100000:0.0:1788201321.740894:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622513664 00000100:00100000:0.0:1788201321.740920:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201321.740926:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622513792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201321.740967:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875064622513792:12345-0@lo:400:kworker.0 Request processed in 41us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201321.740973:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201321.740987:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201321.740993:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875064622513920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201321.741013:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875064622513920:12345-0@lo:400:kworker.0 Request processed in 21us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201321.741018:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201321.741027:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201321.741032:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622513664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201321.741051:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875064622513664:12345-0@lo:400:kworker.0 Request processed in 19us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201321.741056:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201321.741086:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1875064622513920:0@lo:400:kworker.0 00000100:00100000:0.0:1788201321.741095:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1875064622513792:0@lo:400:kworker.0 00000100:00080000:0.0:1788201321.741115:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201321.742288:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622513408 00000100:00100000:2.0:1788201321.742297:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622513408 00000100:00100000:2.0:1788201321.742346:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788201321.742355:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:3294:x1875064622513408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201321.742747:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622514048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201321.743487:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622513536:0@lo:400:kworker.0 00000100:00100000:1.0:1788201321.753894:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201321.754000:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622514048 00000100:00100000:1.0:1788201321.754025:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622514048 00000100:00100000:1.0:1788201321.754106:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201321.754117:0:15154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1875064622514048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201321.754178:0:15154:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201321.754308:0:15154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1875064622514048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 192us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201321.754316:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788201321.754345:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201321.754828:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1875064622514048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201321.760821:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201321.761043:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875064622513664:0@lo:400:kworker.0 00000100:00100000:1.0:1788201321.761287:0:15152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622513536 00000100:00100000:1.0:1788201321.761297:0:15152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622513536 00000100:00100000:1.0:1788201321.761360:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201321.761608:0:15152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3293:x1875064622513536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201321.763507:0:15152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3293:x1875064622513536:12345-0@lo:400:kworker.0 Request processed in 2023us (2685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201321.763527:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201321.763620:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622513536:0@lo:400:kworker.0 00000100:00100000:2.0:1788201321.763899:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:3294:x1875064622513408:12345-0@lo:400:kworker.0 Request processed in 21542us (23158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201321.763912:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788201321.769232:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201321.769299:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614139136 00000100:00100000:3.0:1788201321.769312:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614139136 00000100:00100000:0.0:1788201321.769381:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3294:1875064622513408:0@lo:400:kworker.0 00000100:00100000:3.0:1788201321.769398:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:3.0:1788201321.769411:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc130956-7593-4d7c-b6a5-5684b4485823+6:13907:x1875064614139136:12345-192.168.203.14@tcp:101:mkdir.0 00010000:00010000:3.0:1788201321.769441:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201321.769470:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2a00/0x72011f792b787f00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d31c2 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201321.769559:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2000/0x72011f792b787f07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201321.769578:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2000/0x72011f792b787f07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201321.769594:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2000/0x72011f792b787f07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201321.770284:0:14469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788201321.770293:0:14469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201321.770404:0:14469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2000/0x72011f792b787f07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201321.770443:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2a00/0x72011f792b787f00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31c2 expref: 8 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201321.770476:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2000/0x72011f792b787f07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31c2 expref: 7 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201321.770485:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0004dfd400) 00010000:00010000:3.0:1788201321.770489:0:14469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201321.770492:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aff030d2000, rc 0) 00000100:00100000:3.0:1788201321.770577:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc130956-7593-4d7c-b6a5-5684b4485823+7:13907:x1875064614139136:12345-192.168.203.14@tcp:101:mkdir.0 Request processed in 1168us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201321.770585:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 14 00000001:00100000:2.0:1788201321.830165:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dc130956-7593-4d7c-b6a5-5684b4485823 00000001:00100000:2.0:1788201321.830179:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d 00000001:00080000:2.0:1788201321.830186:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788201321.830195:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788201322.443664:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201323.468302:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201324.221882:0:16427:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1788201324.352601:0:5849:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d 00000001:00100000:3.0:1788201324.352616:0:5849:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dc130956-7593-4d7c-b6a5-5684b4485823 00010000:00010000:3.0:1788201324.491431:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788201324.875666:0:6702:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dc130956-7593-4d7c-b6a5-5684b4485823 00010000:00010000:2.0:1788201325.515582:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201326.541751:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201326.863007:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622514304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201326.863075:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201326.863122:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622514176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201326.863159:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201326.863204:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622514304 00000100:00100000:3.0:1788201326.863211:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622514304 00000100:00100000:3.0:1788201326.863252:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622514176 00000100:00100000:3.0:1788201326.863255:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622514176 00000100:00100000:3.0:1788201326.863272:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201326.863280:0:15154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622514304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201326.863312:0:15154:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201326.863374:0:15154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622514304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201326.863381:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201326.863398:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201326.863404:0:15154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622514176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201326.863421:0:15154:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201326.863447:0:15154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622514176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201326.863453:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788201326.863471:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201326.863475:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201326.863610:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622514304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201326.863623:0:3293:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788201326.863644:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622514176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201326.865748:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622514560:0@lo:400:kworker.0 00000100:00100000:2.0:1788201326.865814:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201326.865858:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201326.865864:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3295:1875064622514432:0@lo:400:kworker.0 00000100:00100000:2.0:1788201326.865891:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201326.865929:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622514560 00000100:00100000:2.0:1788201326.865935:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622514560 00000100:00100000:2.0:1788201326.865977:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201326.865985:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622514560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201326.866036:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875064622514560:12345-0@lo:400:kworker.0 Request processed in 51us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201326.866043:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201326.866062:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622514432 00000100:00100000:2.0:1788201326.866065:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622514432 00000100:00100000:2.0:1788201326.866089:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788201326.866095:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:3295:x1875064622514432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201326.866123:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:3295:x1875064622514432:12345-0@lo:400:kworker.0 Request processed in 28us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201326.866129:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788201326.866177:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622514688:0@lo:400:kworker.0 00000100:00100000:2.0:1788201326.867121:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201326.867179:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201326.867188:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003b0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622514816:0@lo:400:kworker.0 00000100:00100000:2.0:1788201326.867234:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201326.867264:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622514688 00000100:00100000:2.0:1788201326.867269:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622514688 00000100:00100000:2.0:1788201326.867307:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622514816 00000100:00100000:2.0:1788201326.867310:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622514816 00000100:00100000:2.0:1788201326.867339:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201326.867347:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622514688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201326.867387:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622514688:12345-0@lo:400:kworker.0 Request processed in 41us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201326.867394:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201326.867406:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201326.867412:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622514816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201326.867434:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875064622514816:12345-0@lo:400:kworker.0 Request processed in 23us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201326.867439:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788201326.867454:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201326.867480:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3295:1875064622514432:0@lo:400:kworker.0 00000100:00100000:2.0:1788201326.867493:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875064622514560:0@lo:400:kworker.0 00000100:00100000:2.0:1788201326.867518:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1875064622514816:0@lo:400:kworker.0 00000100:00100000:2.0:1788201326.867526:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003b0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622514688:0@lo:400:kworker.0 00000100:00100000:2.0:1788201326.889879:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201326.889921:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201326.889948:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201326.889974:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201326.889990:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201326.890006:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201326.890029:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201326.890051:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614139648 00000100:00100000:2.0:1788201326.890060:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614139648 00000100:00100000:2.0:1788201326.890110:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614139904 00000100:00100000:2.0:1788201326.890123:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614139904 00000100:00100000:2.0:1788201326.890167:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614139520 00000100:00100000:2.0:1788201326.890170:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614139520 00000100:00100000:2.0:1788201326.890180:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614140032 00000100:00100000:2.0:1788201326.890183:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614140032 00000100:00100000:2.0:1788201326.890272:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:2.0:1788201326.890283:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+5:2349:x1875064614139648:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201326.890357:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+5:2349:x1875064614139648:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 76us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201326.890365:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:2.0:1788201326.890380:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:2.0:1788201326.890387:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dc130956-7593-4d7c-b6a5-5684b4485823+5:2349:x1875064614139904:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201326.890411:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dc130956-7593-4d7c-b6a5-5684b4485823+5:2349:x1875064614139904:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 24us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201326.890416:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:2.0:1788201326.890425:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:2.0:1788201326.890431:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+5:2349:x1875064614139520:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201326.890450:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+5:2349:x1875064614139520:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 20us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201326.890456:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:2.0:1788201326.890467:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:2.0:1788201326.890473:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dc130956-7593-4d7c-b6a5-5684b4485823+5:2349:x1875064614140032:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201326.890496:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dc130956-7593-4d7c-b6a5-5684b4485823+5:2349:x1875064614140032:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 23us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201326.890502:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:2.0:1788201326.890540:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614139264 00000100:00100000:2.0:1788201326.890544:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614139264 00000100:00100000:2.0:1788201326.890571:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 105 00000100:00100000:2.0:1788201326.890577:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+13:2349:x1875064614139264:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201326.890604:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+13:2349:x1875064614139264:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 28us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201326.890611:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 105 00000100:00100000:2.0:1788201326.891093:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614139392 00000100:00100000:2.0:1788201326.891098:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614139392 00000100:00100000:2.0:1788201326.891168:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614139776 00000100:00100000:2.0:1788201326.891172:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614139776 00000100:00100000:2.0:1788201326.891196:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:2.0:1788201326.891212:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:2349:x1875064614139392:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201326.891248:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:2349:x1875064614139392:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 45us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201326.891255:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:2.0:1788201326.891268:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:2.0:1788201326.891273:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dc130956-7593-4d7c-b6a5-5684b4485823+6:2349:x1875064614139776:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201326.891295:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dc130956-7593-4d7c-b6a5-5684b4485823+6:2349:x1875064614139776:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 22us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201326.891300:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00080000:2.0:1788201326.891345:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201326.891349:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201326.891351:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788201327.563568:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201327.767472:0:16579:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2c2b41c0 20000000:00000080:0.0:1788201327.767489:0:16579:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9aff031f4000 uarg=0000000000000000 20000000:01000000:0.0:1788201327.767526:0:16579:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788201327.767531:0:16579:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788201327.767537:0:16579:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788201327.768338:0:16580:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788201327.768505:0:16579:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788201327.774447:0:16579:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788201327.774475:0:16579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b000676e800/0x72011f792b787f0e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201327.774494:0:16579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0001681400/0x72011f792b787c05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787bfe expref: 18 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201327.774502:0:16579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0000030800/0x72011f792b787c52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787c4b expref: 18 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201327.774509:0:16579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b001f8f1e00/0x72011f792b787d86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787d7f expref: 18 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201327.774518:0:16579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b003c077800/0x72011f792b787eac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3136 expref: 12 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201327.774525:0:16579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b003c076000/0x72011f792b787ee4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3198 expref: 12 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201327.774532:0:16579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b000676e800/0x72011f792b787f0e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201327.774569:0:16579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b003c076000/0x72011f792b787ee4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3198 expref: 12 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201327.774582:0:16579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b003c076000/0x72011f792b787ee4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3198 expref: 12 pid: 14462 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201327.774596:0:16579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f04380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1875064622514944:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788201327.774734:0:16579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b003c077800/0x72011f792b787eac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3136 expref: 12 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201327.774751:0:16579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b003c077800/0x72011f792b787eac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3136 expref: 12 pid: 14462 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201327.774760:0:16579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f07b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1875064622515072:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788201327.774787:0:16579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b001f8f1e00/0x72011f792b787d86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b787d7f expref: 18 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201327.774794:0:16579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b001f8f1e00/0x72011f792b787d86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b787d7f expref: 18 pid: 14461 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201327.774803:0:16579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f04000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1875064622515200:0@lo:104: 00000100:00100000:0.0:1788201327.774844:0:16579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201327.774879:0:16579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0000030800/0x72011f792b787c52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b787c4b expref: 18 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201327.774887:0:16579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0000030800/0x72011f792b787c52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b787c4b expref: 18 pid: 14461 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201327.774894:0:16579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f04a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1875064622515328:0@lo:104: 00000100:00100000:0.0:1788201327.774910:0:16579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201327.774933:0:16579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0001681400/0x72011f792b787c05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72011f792b787bfe expref: 18 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201327.774940:0:16579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0001681400/0x72011f792b787c05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72011f792b787bfe expref: 18 pid: 14463 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201327.774948:0:16579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f06d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1875064622515456:0@lo:104: 00000100:00100000:0.0:1788201327.774967:0:16579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201327.774982:0:16579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f39f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201327.775049:0:14451:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201327.775065:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622515200 00000100:00100000:1.0:1788201327.775071:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622515200 00000100:00100000:1.0:1788201327.775103:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622515328 00000100:00100000:1.0:1788201327.775105:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622515328 00000100:00100000:1.0:1788201327.775112:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622515456 00000100:00100000:1.0:1788201327.775114:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622515456 00000100:00100000:1.0:1788201327.775160:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201327.775170:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+5:16579:x1875064622515200:12345-0@lo:104: 00010000:00010000:1.0:1788201327.775181:0:14451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b787d7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b787d86 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775240:0:14451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201327.775245:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+5:16579:x1875064622515200:12345-0@lo:104: Request processed in 77us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201327.775251:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201327.775266:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201327.775271:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+4:16579:x1875064622515328:12345-0@lo:104: 00010000:00010000:1.0:1788201327.775277:0:14451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b000676fc00/0x72011f792b787c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b787c52 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775302:0:14451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788201327.775307:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+4:16579:x1875064622515328:12345-0@lo:104: Request processed in 36us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201327.775312:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201327.775321:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201327.775326:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003214850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+3:16579:x1875064622515456:12345-0@lo:104: 00010000:00010000:1.0:1788201327.775332:0:14451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff9b000676f800/0x72011f792b787bfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b787c05 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775351:0:14451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788201327.775355:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003214850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+3:16579:x1875064622515456:12345-0@lo:104: Request processed in 29us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201327.775360:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788201327.775401:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201327.775410:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b787d7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b787d86 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775417:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0000031000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1788201327.775421:0:14457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b787d7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b787d86 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775429:0:14457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b787d7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b787d86 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201327.775436:0:14457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b787d7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b787d86 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201327.775442:0:14457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788201327.775464:0:14457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b787d7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787d86 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775470:0:14457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201327.775485:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b787d7f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787d86 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775492:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b0000031000/0x72011f792b787d7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787d86 expref: -99 pid: 15869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775505:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201327.775507:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b000676fc00/0x72011f792b787c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b787c52 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775512:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676fc00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1788201327.775515:0:14457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b000676fc00/0x72011f792b787c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b787c52 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775531:0:14457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b000676fc00/0x72011f792b787c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b787c52 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201327.775537:0:14457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b000676fc00/0x72011f792b787c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b787c52 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201327.775542:0:14457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788201327.775552:0:14457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b000676fc00/0x72011f792b787c4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787c52 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775556:0:14457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201327.775561:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b000676fc00/0x72011f792b787c4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787c52 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775568:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b000676fc00/0x72011f792b787c4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787c52 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775576:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201327.775578:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff9b000676f800/0x72011f792b787bfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72011f792b787c05 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775583:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f800 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1788201327.775585:0:14457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff9b000676f800/0x72011f792b787bfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72011f792b787c05 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775591:0:14457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff9b000676f800/0x72011f792b787bfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72011f792b787c05 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201327.775597:0:14457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff9b000676f800/0x72011f792b787bfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72011f792b787c05 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201327.775606:0:14457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788201327.775617:0:14457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff9b000676f800/0x72011f792b787bfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787c05 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775623:0:14457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201327.775635:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff9b000676f800/0x72011f792b787bfe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787c05 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775642:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff9b000676f800/0x72011f792b787bfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72011f792b787c05 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775653:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201327.775654:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201327.775656:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201327.775671:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3294:1875064622515584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201327.775695:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201327.775717:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201327.775722:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3294:1875064622515712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201327.775736:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201327.775754:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622515584 00000100:00100000:1.0:1788201327.775757:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622515584 00010000:00010000:1.0:1788201327.775772:0:14455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b001f8f1e00/0x72011f792b787d86 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b787d7f expref: 19 pid: 14461 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201327.775789:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622515712 00000100:00100000:1.0:1788201327.775791:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622515712 00010000:00010000:1.0:1788201327.775799:0:14455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0000030800/0x72011f792b787c52 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b787c4b expref: 20 pid: 14461 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201327.775820:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201327.775837:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+20:3294:x1875064622515584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201327.775847:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201327.775853:0:14455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b001f8f1e00/0x72011f792b787d86 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b787d7f expref: 20 pid: 14461 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775862:0:14455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b001f8f1e00/0x72011f792b787d86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b787d7f expref: 20 pid: 14461 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775875:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201327.775898:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+20:3294:x1875064622515584:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201327.775903:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201327.775914:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201327.775919:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:3294:x1875064622515712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201327.775924:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201327.775928:0:14455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0000030800/0x72011f792b787c52 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b787c4b expref: 19 pid: 14461 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775936:0:14455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0000030800/0x72011f792b787c52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b787c4b expref: 19 pid: 14461 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201327.775945:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201327.775959:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:3294:x1875064622515712:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201327.775965:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201327.775992:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3294:1875064622515712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201327.776006:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3294:1875064622515584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201327.776237:0:16579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b001f8f1e00/0x72011f792b787d86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b787d7f expref: 18 pid: 14461 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201327.776248:0:16579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f04000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1875064622515200:0@lo:104: 00010000:00010000:0.0:1788201327.776255:0:16579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0000030800/0x72011f792b787c52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b787c4b expref: 17 pid: 14461 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201327.776262:0:16579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f04a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1875064622515328:0@lo:104: 00000100:00100000:0.0:1788201327.776269:0:16579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f06d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1875064622515456:0@lo:104: 00010000:00010000:3.0:1788201327.782021:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201327.783358:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3292:1875064622515840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201327.783436:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201327.783660:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622515840 00000100:00100000:2.0:1788201327.783668:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622515840 00010000:00010000:2.0:1788201327.783717:0:14453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0001681400/0x72011f792b787c05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b787bfe expref: 17 pid: 14463 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201327.783757:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201327.783766:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f535850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+17:3292:x1875064622515840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201327.783780:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201327.783786:0:14453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0001681400/0x72011f792b787c05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72011f792b787bfe expref: 17 pid: 14463 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201327.783798:0:14453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0001681400/0x72011f792b787c05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72011f792b787bfe expref: 17 pid: 14463 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201327.783816:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0001681400/0x72011f792b787c05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72011f792b787bfe expref: 17 pid: 14463 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201327.783843:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201327.783887:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f535850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:3292:x1875064622515840:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201327.783895:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201327.783967:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3292:1875064622515840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201327.786626:0:16579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f04380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1875064622514944:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788201327.786642:0:16579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f07b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16579:1875064622515072:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788201327.786675:0:16579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b000676e800/0x72011f792b787f0e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201327.787987:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201327.788069:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201327.788271:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614140160 00000100:00100000:2.0:1788201327.788280:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614140160 00010000:00010000:2.0:1788201327.788315:0:14453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b003c076000/0x72011f792b787ee4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3198 expref: 13 pid: 14462 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201327.788343:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614140288 00000100:00100000:2.0:1788201327.788345:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614140288 00010000:00010000:2.0:1788201327.788356:0:14453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b003c077800/0x72011f792b787eac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3136 expref: 14 pid: 14462 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201327.788391:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:2.0:1788201327.788399:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6907c23-6974-4cbd-b040-4be99751a9b0+14:2349:x1875064614140160:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201327.788414:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201327.788420:0:14453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b003c076000/0x72011f792b787ee4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3198 expref: 14 pid: 14462 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201327.788433:0:14453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b003c076000/0x72011f792b787ee4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3198 expref: 14 pid: 14462 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201327.788452:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b003c076000/0x72011f792b787ee4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3198 expref: 14 pid: 14462 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201327.788466:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201327.788523:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6907c23-6974-4cbd-b040-4be99751a9b0+13:2349:x1875064614140160:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 124us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201327.788531:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:2.0:1788201327.788548:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:2.0:1788201327.788554:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6907c23-6974-4cbd-b040-4be99751a9b0+12:2349:x1875064614140288:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201327.788561:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201327.788565:0:14453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b003c077800/0x72011f792b787eac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3136 expref: 12 pid: 14462 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201327.788574:0:14453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b003c077800/0x72011f792b787eac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3136 expref: 12 pid: 14462 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201327.788584:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b003c077800/0x72011f792b787eac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3136 expref: 12 pid: 14462 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201327.788601:0:14453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b000676e800/0x72011f792b787f0e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201327.788609:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b000676e800/0x72011f792b787f0e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201327.788622:0:14453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b000676e800/0x72011f792b787f0e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201327.788628:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b000676e800/0x72011f792b787f0e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201327.788635:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b000676e800/0x72011f792b787f0e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201327.788642:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b000676e800/0x72011f792b787f0e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201327.788648:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676e800 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:2.0:1788201327.788652:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b000676e800/0x72011f792b787f0e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201327.788659:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b000676e800/0x72011f792b787f0e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201327.788672:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b000676e800/0x72011f792b787f0e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201327.788680:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201327.788699:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6907c23-6974-4cbd-b040-4be99751a9b0+11:2349:x1875064614140288:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 146us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201327.788711:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00010000:00010000:0.0:1788201327.789051:0:16579:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b000676e800/0x72011f792b787f0e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201327.789061:0:16579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b000676e800/0x72011f792b787f0e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201327.789067:0:16579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b000676e800/0x72011f792b787f0e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.587314:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788201328.908472:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788201329.292398:0:14466:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788201329.292406:0:14466:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b003f5cc800 from 10 10000000:01000000:1.0:1788201329.292411:0:14466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201329.292475:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b003c076800/0x72011f792b787f15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201329.292487:0:14466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b003c076800/0x72011f792b787f15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201329.292498:0:14466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b003c076800/0x72011f792b787f15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201329.292524:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622515968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201329.292593:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201329.292666:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0006323e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201329.292667:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622515968 00000100:00100000:2.0:1788201329.292677:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622515968 00000100:00100000:2.0:1788201329.292729:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788201329.292738:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+16:14466:x1875064622515968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201329.292749:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201329.292760:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b001f8f1000/0x72011f792b787f1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787f15 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201329.292780:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b001f8f1000/0x72011f792b787f1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787f15 expref: 17 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201329.292790:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b001f8f1000/0x72011f792b787f1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787f15 expref: 17 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201329.292798:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1000, rc 0) 00000100:00100000:2.0:1788201329.292855:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+17:14466:x1875064622515968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201329.292861:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788201329.293531:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622515968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201329.293547:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b003c076800/0x72011f792b787f15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787f1c expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201329.293556:0:14466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b003c076800/0x72011f792b787f15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787f1c expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201329.293613:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622516096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201329.293644:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201329.293678:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0006323e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201329.293908:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622516096 00000100:00100000:2.0:1788201329.293923:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622516096 00000100:00100000:2.0:1788201329.293963:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788201329.293972:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+17:14466:x1875064622516096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201329.295013:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+17:14466:x1875064622516096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1038us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201329.295023:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788201329.295706:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622516096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201329.295768:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622516224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201329.295839:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201329.295938:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0006323e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201329.296073:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622516224 00000100:00100000:2.0:1788201329.296080:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622516224 00000100:00100000:2.0:1788201329.296203:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788201329.296212:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+17:14466:x1875064622516224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201329.296416:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+17:14466:x1875064622516224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201329.296424:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788201329.296512:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622516224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201329.299313:0:16658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788201329.299770:0:14466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788201329.299796:0:14466:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201329.299806:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b003c076800/0x72011f792b787f15 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787f1c expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.299829:0:14466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b003c076800/0x72011f792b787f15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787f1c expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201329.299839:0:14466:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788201329.299842:0:14466:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b0026f59000 from 10 10000000:01000000:3.0:1788201329.299844:0:14466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201329.299895:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9aff030d2a00/0x72011f792b787f23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.299902:0:14466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9aff030d2a00/0x72011f792b787f23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.299913:0:14466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9aff030d2a00/0x72011f792b787f23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201329.299942:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622516352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201329.300006:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201329.300052:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0011e35d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201329.300083:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622516352 00000100:00100000:2.0:1788201329.300091:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622516352 00000100:00100000:2.0:1788201329.300171:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788201329.300246:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+17:14466:x1875064622516352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201329.300259:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201329.300272:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b001f8f1e00/0x72011f792b787f2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787f23 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201329.300295:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b001f8f1e00/0x72011f792b787f2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787f23 expref: 18 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201329.300808:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b001f8f1e00/0x72011f792b787f2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787f23 expref: 18 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201329.300829:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1e00, rc 0) 00000100:00100000:2.0:1788201329.300886:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+18:14466:x1875064622516352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 707us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201329.300893:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788201329.300974:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622516352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201329.300988:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9aff030d2a00/0x72011f792b787f23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787f2a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.300998:0:14466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9aff030d2a00/0x72011f792b787f23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787f2a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201329.301054:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622516480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201329.301083:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201329.301115:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0011e35d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201329.301705:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622516480 00000100:00100000:2.0:1788201329.301711:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622516480 00000100:00100000:2.0:1788201329.301748:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788201329.301756:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003fc69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+18:14466:x1875064622516480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201329.302117:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003fc69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+18:14466:x1875064622516480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201329.302180:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788201329.302262:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622516480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201329.302299:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622516608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201329.302340:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201329.302369:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0011e35d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201329.302688:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622516608 00000100:00100000:2.0:1788201329.302692:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622516608 00000100:00100000:2.0:1788201329.302725:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788201329.302733:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+18:14466:x1875064622516608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201329.302893:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+18:14466:x1875064622516608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201329.302900:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788201329.305708:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201329.305791:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614140416 00000100:00100000:3.0:1788201329.305812:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614140416 00000100:00100000:3.0:1788201329.306405:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 112 00000100:00100000:3.0:1788201329.306417:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6907c23-6974-4cbd-b040-4be99751a9b0+11:13759:x1875064614140416:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201329.306435:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788201329.306895:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622516608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201329.309051:0:16659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788201329.309366:0:14466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788201329.309386:0:14466:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201329.309398:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9aff030d2a00/0x72011f792b787f23 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787f2a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.309422:0:14466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9aff030d2a00/0x72011f792b787f23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787f2a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201329.309434:0:14466:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201329.309436:0:14466:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9aff0131b800 from 10 10000000:01000000:0.0:1788201329.309439:0:14466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201329.309474:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787f31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.309482:0:14466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787f31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.309494:0:14466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787f31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201329.309531:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622516736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201329.309599:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201329.309649:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f39f600 going to sleep for 11 seconds 00010000:00010000:3.0:1788201329.309658:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aff030d2600/0x72011f792b787f38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d31c9 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.309687:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aff030d2600/0x72011f792b787f38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31c9 expref: 12 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.309699:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aff030d2600/0x72011f792b787f38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31c9 expref: 12 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.309709:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aff030d2600, rc 0) 00000100:00100000:3.0:1788201329.309767:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6907c23-6974-4cbd-b040-4be99751a9b0+12:13759:x1875064614140416:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 Request processed in 3353us (4068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201329.309776:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 112 00000100:00100000:3.0:1788201329.309807:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622516736 00000100:00100000:3.0:1788201329.309825:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622516736 00000100:00100000:3.0:1788201329.309865:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788201329.309873:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+18:14466:x1875064622516736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201329.309883:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201329.309891:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aff030d2e00/0x72011f792b787f3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72011f792b787f31 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.309904:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aff030d2e00/0x72011f792b787f3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72011f792b787f31 expref: 19 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.309912:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aff030d2e00/0x72011f792b787f3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72011f792b787f31 expref: 19 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.309925:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aff030d2e00, rc 0) 00000100:00100000:3.0:1788201329.312889:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:14466:x1875064622516736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3007us (3282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201329.312902:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788201329.313035:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622516736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201329.313060:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787f31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787f3f expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201329.313476:0:14466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787f31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72011f792b787f3f expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201329.313792:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622516864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201329.313847:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201329.314200:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00109413c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201329.314308:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622516864 00000100:00100000:1.0:1788201329.314316:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622516864 00000100:00100000:1.0:1788201329.314393:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788201329.314404:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:14466:x1875064622516864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201329.314721:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:14466:x1875064622516864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 319us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.314729:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788201329.314960:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622516864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201329.315000:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004067a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622516992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201329.315042:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201329.315100:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b00109413c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201329.315154:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622516992 00000100:00100000:1.0:1788201329.315158:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622516992 00000100:00100000:1.0:1788201329.315190:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788201329.315197:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:14466:x1875064622516992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201329.315348:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:14466:x1875064622516992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.315356:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788201329.315398:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004067a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:14466:1875064622516992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201329.316265:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201329.316333:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614140544 00000100:00100000:3.0:1788201329.316340:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614140544 00000100:00100000:3.0:1788201329.316379:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 116 00000100:00100000:3.0:1788201329.316387:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+12:13759:x1875064614140544:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201329.316625:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+12:13759:x1875064614140544:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 Request processed in 238us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201329.316634:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 116 00000040:00080000:2.0:1788201329.318457:0:16661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788201329.318624:0:14466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788201329.318660:0:14466:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201329.318671:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787f31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787f3f expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201329.318696:0:14466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff9b000676ec00/0x72011f792b787f31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72011f792b787f3f expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201329.326562:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201329.326650:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614140672 00000100:00100000:3.0:1788201329.326660:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614140672 00000100:00100000:3.0:1788201329.326726:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 117 00000100:00100000:3.0:1788201329.326737:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+12:13759:x1875064614140672:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201329.326955:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+12:13759:x1875064614140672:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 Request processed in 219us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201329.326962:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 117 00000100:00100000:3.0:1788201329.338476:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201329.338825:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614140800 00000100:00100000:1.0:1788201329.338834:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614140800 00000100:00100000:1.0:1788201329.338882:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 118 00000100:00100000:1.0:1788201329.338892:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6907c23-6974-4cbd-b040-4be99751a9b0+12:13759:x1875064614140800:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201329.338909:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201329.338927:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b003c077e00/0x72011f792b787f46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d31d0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201329.338954:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b003c077e00/0x72011f792b787f46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31d0 expref: 13 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201329.338964:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b003c077e00/0x72011f792b787f46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31d0 expref: 13 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201329.338973:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b003c077e00, rc 0) 00000100:00100000:1.0:1788201329.339030:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6907c23-6974-4cbd-b040-4be99751a9b0+13:13759:x1875064614140800:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 Request processed in 140us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.339037:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 118 00000100:00100000:3.0:1788201329.341993:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201329.342899:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614140928 00000100:00100000:0.0:1788201329.342910:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614140928 00000100:00100000:0.0:1788201329.342971:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 119 00000100:00100000:0.0:1788201329.342983:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+13:13759:x1875064614140928:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201329.343303:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6907c23-6974-4cbd-b040-4be99751a9b0+13:13759:x1875064614140928:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 Request processed in 321us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201329.343311:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 119 00000100:00100000:2.0:1788201329.348831:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201329.350245:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614141056 00000100:00100000:1.0:1788201329.350257:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614141056 00000100:00100000:1.0:1788201329.350317:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 120 00000100:00100000:1.0:1788201329.350329:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+13:13759:x1875064614141056:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201329.350551:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+13:13759:x1875064614141056:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 Request processed in 225us (1741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.350560:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 120 00010000:00010000:0.0:1788201329.611430:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201330.635298:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201330.679596:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201330.679786:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614141184 00000100:00100000:3.0:1788201330.679799:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614141184 00000100:00100000:3.0:1788201330.679901:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:3.0:1788201330.679915:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:14417:x1875064614141184:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201330.679967:0:14470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201330.679995:0:14470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787f4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d31d7 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.680085:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f54 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.680104:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.680117:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.680190:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.680198:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.680205:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.680704:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3000/0x72011f792b787f62 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.680716:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3000/0x72011f792b787f62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.680724:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3000/0x72011f792b787f62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201330.680826:0:14470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788201330.680837:0:14470:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201330.680942:0:14470:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3000/0x72011f792b787f62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.680957:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.680964:0:14470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f54 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.680972:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.680980:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d3c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201330.680985:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.680993:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.681012:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0004dfd400) 00010000:00010000:3.0:1788201330.681014:0:14470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201330.681020:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.681027:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.681041:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.681047:0:14470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.681062:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.681067:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d3800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201330.681070:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.681077:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.681084:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b002df50e00) 00010000:00010000:3.0:1788201330.681087:0:14470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201330.681089:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f5b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.681094:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.681196:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787f4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31d7 expref: 8 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.681211:0:14470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3000/0x72011f792b787f62 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31d7 expref: 7 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.681218:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b002df50a00) 00010000:00010000:3.0:1788201330.681220:0:14470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201330.681223:0:14470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aff030d3000, rc 0) 00000100:00100000:3.0:1788201330.681304:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+7:14417:x1875064614141184:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 1392us (1722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201330.681322:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00080000:2.0:1788201330.681500:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201330.690036:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201330.690194:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614141440 00000100:00100000:1.0:1788201330.690208:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614141440 00000100:00100000:1.0:1788201330.690276:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:1.0:1788201330.690288:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+7:14417:x1875064614141440:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201330.690316:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201330.690356:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b787f69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d31de expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.690481:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076200/0x72011f792b787f70 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.690498:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076200/0x72011f792b787f70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.690511:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076200/0x72011f792b787f70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.690673:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077400/0x72011f792b787f77 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.690698:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077400/0x72011f792b787f77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.690710:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077400/0x72011f792b787f77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.691317:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077200/0x72011f792b787f7e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.691328:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077200/0x72011f792b787f7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.691336:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077200/0x72011f792b787f7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201330.691348:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1788201330.691592:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076200/0x72011f792b787f70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.691600:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076200/0x72011f792b787f70 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.691608:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076200/0x72011f792b787f70 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.691614:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c076200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201330.691618:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076200/0x72011f792b787f70 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.691625:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076200/0x72011f792b787f70 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.691637:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b002df50a00) 00010000:00010000:1.0:1788201330.691641:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201330.691645:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076200/0x72011f792b787f70 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.691662:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076200/0x72011f792b787f70 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.691676:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077400/0x72011f792b787f77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.691682:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077400/0x72011f792b787f77 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.691688:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077400/0x72011f792b787f77 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.691693:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c077400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201330.691695:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077400/0x72011f792b787f77 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.691701:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077400/0x72011f792b787f77 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.691708:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b0004dfd500) 00010000:00010000:1.0:1788201330.691710:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201330.691713:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077400/0x72011f792b787f77 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.691719:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077400/0x72011f792b787f77 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.692194:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b787f69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31de expref: 10 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.692223:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077200/0x72011f792b787f7e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31de expref: 9 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.692231:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b0004dfd900) 00010000:00010000:1.0:1788201330.692233:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201330.692235:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b003c077200, rc 0) 00000100:00100000:1.0:1788201330.694366:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+9:14417:x1875064614141440:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 4070us (4335us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788201330.694378:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:2.0:1788201330.705035:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201330.706364:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614141568 00000100:00100000:3.0:1788201330.706385:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614141568 00000100:00100000:1.0:1788201330.706661:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:1.0:1788201330.706685:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+9:14417:x1875064614141568:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788201330.706821:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+9:14417:x1875064614141568:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 Request processed in 147us (1802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201330.706828:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:2.0:1788201330.741306:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201330.741606:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614141696 00000100:00100000:3.0:1788201330.741619:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614141696 00000100:00100000:3.0:1788201330.741761:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:3.0:1788201330.741774:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+9:14423:x1875064614141696:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788201330.741800:0:15174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201330.741841:0:15174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787f8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d31e5 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.741929:0:15174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.741946:0:15174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.741961:0:15174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.741980:0:15174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.741987:0:15174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.741994:0:15174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.742366:0:15174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.742384:0:15174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.742390:0:15174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.742396:0:15174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d3800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201330.742401:0:15174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.742409:0:15174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.742437:0:15174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0004dfd400) 00010000:00010000:3.0:1788201330.742440:0:15174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201330.742446:0:15174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.742453:0:15174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787f93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.742467:0:15174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.742473:0:15174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.742478:0:15174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.742483:0:15174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d3c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201330.742492:0:15174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.742498:0:15174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.742506:0:15174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b002df50e00) 00010000:00010000:3.0:1788201330.742509:0:15174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201330.742512:0:15174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.742518:0:15174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787f9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.742556:0:15174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787f8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31e5 expref: 10 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.742567:0:15174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0004dfd400) 00010000:00010000:3.0:1788201330.742569:0:15174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201330.742573:0:15174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787f8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31e5 expref: 10 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.742582:0:15174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aff030d2200, rc 0) 00000100:00100000:3.0:1788201330.742661:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+9:14423:x1875064614141696:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 889us (1372us total) trans 0 rc 301/301 00000100:00100000:3.0:1788201330.742670:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:2.0:1788201330.749191:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201330.749688:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614141824 00000100:00100000:1.0:1788201330.749702:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614141824 00000100:00100000:1.0:1788201330.749919:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:1.0:1788201330.749933:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0040679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+9:14423:x1875064614141824:12345-192.168.203.14@tcp:700:lfs.0 00000100:00100000:1.0:1788201330.750059:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0040679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+9:14423:x1875064614141824:12345-192.168.203.14@tcp:700:lfs.0 Request processed in 129us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201330.750067:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:2.0:1788201330.754705:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201330.754945:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614142080 00000100:00100000:3.0:1788201330.754957:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614142080 00000100:00100000:3.0:1788201330.755035:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:3.0:1788201330.755048:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+9:14423:x1875064614142080:12345-192.168.203.14@tcp:36:lfs.0 00010000:00010000:3.0:1788201330.755197:0:14470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201330.755235:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077600/0x72011f792b787ecf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3160 expref: 9 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.755258:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0004dfd400) 00010000:00010000:3.0:1788201330.755264:0:14470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201330.756952:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787fa1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.756989:0:14470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2000/0x72011f792b787f07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31c2 expref: 5 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.756999:0:14470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787fa1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.757051:0:14470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2000/0x72011f792b787f07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31c2 expref: 5 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.757068:0:14470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2000/0x72011f792b787f07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31c2 expref: 5 pid: 14469 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201330.757090:0:14470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004052f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14470:1875064622517120:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201330.757257:0:14470:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010194000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201330.760577:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201330.760848:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614142208 00000100:00100000:0.0:1788201330.760879:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614142208 00010000:00010000:0.0:1788201330.760958:0:14453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2000/0x72011f792b787f07 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31c2 expref: 6 pid: 14469 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201330.761010:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:0.0:1788201330.761022:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc130956-7593-4d7c-b6a5-5684b4485823+6:2348:x1875064614142208:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201330.761041:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201330.761049:0:14453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2000/0x72011f792b787f07 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31c2 expref: 6 pid: 14469 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.761064:0:14453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2000/0x72011f792b787f07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31c2 expref: 6 pid: 14469 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.761105:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0004dfd400) 00010000:00010000:0.0:1788201330.761111:0:14453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787fa1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.761121:0:14453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.761129:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787fa1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.761241:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201330.761308:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc130956-7593-4d7c-b6a5-5684b4485823+6:2348:x1875064614142208:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 287us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201330.761316:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00010000:00010000:2.0:1788201330.761687:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2000/0x72011f792b787f07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31c2 expref: 5 pid: 14469 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201330.761721:0:14470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004052f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14470:1875064622517120:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788201330.761747:0:14470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.761757:0:14470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.761764:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.761794:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787fa8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.761818:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.761829:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788201330.763532:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788201330.767014:0:14470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788201330.767041:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.767054:0:14470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787fa1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.767064:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787fa1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.767071:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d2200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201330.767077:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787fa1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.767087:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787fa1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.768058:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0004dfd400) 00010000:00010000:2.0:1788201330.768065:0:14470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201330.768073:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787fa1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.768081:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d2200/0x72011f792b787fa1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201330.768322:0:14470:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3163d1f reply state 00000000e07788bf transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201330.768336:0:14470:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201330.768770:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+10:14423:x1875064614142080:12345-192.168.203.14@tcp:36:lfs.0 Request processed in 13718us (14071us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788201330.768800:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00010000:00010000:0.0:1788201330.772695:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.772754:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787fa8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.772763:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787fa8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.772770:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201330.772775:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787fa8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.772784:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787fa8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.772818:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b0011cb3800) 00010000:00010000:0.0:1788201330.772823:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201330.772829:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787fa8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.772835:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b787fa8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201330.870087:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201330.871885:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614142336 00000100:00100000:1.0:1788201330.871906:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614142336 00000100:00100000:1.0:1788201330.872075:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:1.0:1788201330.872089:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+9:14431:x1875064614142336:12345-192.168.203.14@tcp:101:lctl.0 00010000:00010000:1.0:1788201330.872122:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201330.872168:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b787faf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d31ec expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.872257:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077400/0x72011f792b787fb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.872273:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077400/0x72011f792b787fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.872287:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077400/0x72011f792b787fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201330.872368:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788201330.872373:0:14468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201330.872424:0:14468:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077400/0x72011f792b787fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.872456:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b787faf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31ec expref: 11 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.872478:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077400/0x72011f792b787fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31ec expref: 10 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.872487:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0004dfd500) 00010000:00010000:1.0:1788201330.872490:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201330.872494:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b003c077400, rc 0) 00000100:00100000:1.0:1788201330.872581:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+10:14431:x1875064614142336:12345-192.168.203.14@tcp:101:lctl.0 Request processed in 495us (2509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201330.872604:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:2.0:1788201330.896465:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201330.896545:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614142464 00000100:00100000:1.0:1788201330.896560:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614142464 00000100:00100000:1.0:1788201330.896636:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:1.0:1788201330.896649:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc130956-7593-4d7c-b6a5-5684b4485823+5:14432:x1875064614142464:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788201330.896679:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201330.896707:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b787fbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d31f3 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.896914:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076200/0x72011f792b787fc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.896933:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076200/0x72011f792b787fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.896950:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076200/0x72011f792b787fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201330.897029:0:14469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788201330.897033:0:14469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201330.897060:0:14469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076200/0x72011f792b787fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.897085:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b787fbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31f3 expref: 7 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.897102:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076200/0x72011f792b787fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31f3 expref: 6 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.897127:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0004dfd500) 00010000:00010000:1.0:1788201330.897129:0:14469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201330.897164:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b003c076200, rc 0) 00000100:00100000:1.0:1788201330.897235:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc130956-7593-4d7c-b6a5-5684b4485823+6:14432:x1875064614142464:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 587us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201330.897244:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:2.0:1788201330.901320:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201330.901422:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614142592 00000100:00100000:3.0:1788201330.901434:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614142592 00000100:00100000:3.0:1788201330.901508:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:3.0:1788201330.901520:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc130956-7593-4d7c-b6a5-5684b4485823+6:14432:x1875064614142592:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788201330.901566:0:15174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201330.901595:0:15174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787fcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d31fa expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.901687:0:15174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787fd2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.901706:0:15174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.901726:0:15174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.901744:0:15174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3a00/0x72011f792b787fd9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.901752:0:15174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3a00/0x72011f792b787fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.901759:0:15174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3a00/0x72011f792b787fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902374:0:15174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3400/0x72011f792b787fe0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902475:0:15174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3400/0x72011f792b787fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902489:0:15174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3400/0x72011f792b787fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201330.902559:0:15174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788201330.902577:0:15174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201330.902608:0:15174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3400/0x72011f792b787fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902623:0:15174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902630:0:15174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787fd2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902637:0:15174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902643:0:15174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d3800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201330.902647:0:15174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902655:0:15174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787fd2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902667:0:15174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0004dfd500) 00010000:00010000:3.0:1788201330.902670:0:15174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201330.902675:0:15174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787fd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902681:0:15174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b787fd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902696:0:15174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3a00/0x72011f792b787fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902703:0:15174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3a00/0x72011f792b787fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902721:0:15174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3a00/0x72011f792b787fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902726:0:15174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d3a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201330.902729:0:15174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3a00/0x72011f792b787fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902736:0:15174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3a00/0x72011f792b787fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902744:0:15174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b002df50e00) 00010000:00010000:3.0:1788201330.902747:0:15174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201330.902750:0:15174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3a00/0x72011f792b787fd9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902756:0:15174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3a00/0x72011f792b787fd9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902797:0:15174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b787fcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31fa expref: 8 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902821:0:15174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3400/0x72011f792b787fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31fa expref: 7 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.902828:0:15174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b002df50700) 00010000:00010000:3.0:1788201330.902830:0:15174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201330.902833:0:15174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aff030d3400, rc 0) 00000100:00100000:3.0:1788201330.903967:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc130956-7593-4d7c-b6a5-5684b4485823+7:14432:x1875064614142592:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 2440us (2656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201330.903991:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:0.0:1788201330.907314:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201330.909362:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614142848 00000100:00100000:2.0:1788201330.909383:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614142848 00000100:00100000:2.0:1788201330.909482:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:2.0:1788201330.909494:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dc130956-7593-4d7c-b6a5-5684b4485823+7:14432:x1875064614142848:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788201330.909525:0:14470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201330.909553:0:14470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b787fe7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3201 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201330.909713:0:14470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788201330.909903:0:14470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b787fe7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3201 expref: 9 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.909922:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0004dfd500) 00010000:00010000:2.0:1788201330.909926:0:14470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201330.909932:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b787fe7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3201 expref: 9 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.909950:0:14470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1800, rc 0) 00000100:00100000:2.0:1788201330.910047:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dc130956-7593-4d7c-b6a5-5684b4485823+8:14432:x1875064614142848:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 554us (2740us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788201330.910055:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:2.0:1788201330.915331:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201330.915450:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614143104 00000100:00100000:1.0:1788201330.915462:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614143104 00000100:00100000:1.0:1788201330.915530:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:1.0:1788201330.915542:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004067a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc130956-7593-4d7c-b6a5-5684b4485823+8:14432:x1875064614143104:12345-192.168.203.14@tcp:36:lfs.0 00010000:00010000:1.0:1788201330.916327:0:14468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201330.916368:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3400/0x72011f792b787fe0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d31fa expref: 8 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.916391:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b002df50700) 00010000:00010000:1.0:1788201330.916403:0:14468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201330.916438:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b787ff5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.916454:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b787ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.916465:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b787ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201330.916995:0:14468:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008eba0148 reply state 00000000d5976203 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b787ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201330.917031:0:14468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788201330.917049:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1788201330.918424:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004067a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc130956-7593-4d7c-b6a5-5684b4485823+9:14432:x1875064614143104:12345-192.168.203.14@tcp:36:lfs.0 Request processed in 2872us (3094us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788201330.918439:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 24 00010000:00010000:1.0:1788201330.921006:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b787ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.921029:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b787ff5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.921042:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b787ff5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.921049:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c077c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201330.921055:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b787ff5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.921064:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b787ff5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.921084:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b0004dfd000) 00010000:00010000:1.0:1788201330.921088:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788201330.921092:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b787ff5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.921099:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b787ff5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201330.922786:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201330.922896:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614143360 00000100:00100000:3.0:1788201330.922911:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614143360 00000100:00100000:3.0:1788201330.923018:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:3.0:1788201330.923031:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dc130956-7593-4d7c-b6a5-5684b4485823+8:14432:x1875064614143360:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:3.0:1788201330.923680:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dc130956-7593-4d7c-b6a5-5684b4485823+9:14432:x1875064614143360:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 646us (903us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788201330.923690:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:3.0:1788201330.926184:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201330.926333:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614143616 00000100:00100000:2.0:1788201330.926346:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614143616 00000100:00100000:2.0:1788201330.926415:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:2.0:1788201330.926428:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dc130956-7593-4d7c-b6a5-5684b4485823+9:14432:x1875064614143616:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788201330.926461:0:14470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201330.926486:0:14470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b787ffc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3208 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.926580:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788003 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.926597:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.926609:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.926625:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78800a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.926631:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78800a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.926637:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78800a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201330.926991:0:14470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788201330.927110:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.927119:0:14470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788003 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.927312:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788003 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.927318:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201330.927323:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788003 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.927333:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788003 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.927347:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0004dfd500) 00010000:00010000:2.0:1788201330.927350:0:14470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201330.927357:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788003 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.927363:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788003 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.927379:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78800a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.927385:0:14470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78800a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.927390:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78800a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.927394:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201330.927397:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78800a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.927413:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78800a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.927421:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b0011cb3800) 00010000:00010000:2.0:1788201330.927423:0:14470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201330.927426:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78800a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.927431:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78800a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.927477:0:14470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b787ffc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3208 expref: 11 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.927488:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0004dfd500) 00010000:00010000:2.0:1788201330.927490:0:14470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201330.927493:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b787ffc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3208 expref: 11 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.927502:0:14470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0000, rc 0) 00000100:00100000:2.0:1788201330.927695:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dc130956-7593-4d7c-b6a5-5684b4485823+10:14432:x1875064614143616:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1267us (1570us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788201330.927704:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:2.0:1788201330.931410:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201330.931511:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614143744 00000100:00100000:3.0:1788201330.931523:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614143744 00000100:00100000:3.0:1788201330.931603:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:3.0:1788201330.931616:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc130956-7593-4d7c-b6a5-5684b4485823+10:14432:x1875064614143744:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788201330.931650:0:15174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201330.931681:0:15174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3200/0x72011f792b788018 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d320f expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.932237:0:15174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b78801f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.932257:0:15174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b78801f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.932270:0:15174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b78801f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201330.932405:0:15174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788201330.932427:0:15174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201330.932461:0:15174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b78801f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.932496:0:15174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3200/0x72011f792b788018 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d320f expref: 12 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.932516:0:15174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b78801f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d320f expref: 11 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.932526:0:15174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b002df50e00) 00010000:00010000:3.0:1788201330.932529:0:15174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201330.932534:0:15174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aff030d3c00, rc 0) 00000100:00100000:3.0:1788201330.932644:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc130956-7593-4d7c-b6a5-5684b4485823+11:14432:x1875064614143744:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1030us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201330.932652:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:0.0:1788201330.938891:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201330.939061:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614143872 00000100:00100000:1.0:1788201330.939092:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614143872 00000100:00100000:1.0:1788201330.939304:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:1.0:1788201330.939318:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dc130956-7593-4d7c-b6a5-5684b4485823+11:14432:x1875064614143872:12345-192.168.203.14@tcp:37:lfs.0 00000100:00100000:1.0:1788201330.943058:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dc130956-7593-4d7c-b6a5-5684b4485823+11:14432:x1875064614143872:12345-192.168.203.14@tcp:37:lfs.0 Request processed in 3726us (4165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201330.943075:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:2.0:1788201330.947441:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201330.947567:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614144128 00000100:00100000:3.0:1788201330.947580:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614144128 00000100:00100000:3.0:1788201330.947650:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:3.0:1788201330.947661:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0007194050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dc130956-7593-4d7c-b6a5-5684b4485823+11:14432:x1875064614144128:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:3.0:1788201330.948018:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0007194050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dc130956-7593-4d7c-b6a5-5684b4485823+12:14432:x1875064614144128:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 358us (590us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788201330.948025:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00000040:00080000:2.0:1788201330.956821:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788201331.014939:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201331.015171:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614144256 00000100:00100000:1.0:1788201331.015184:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614144256 00000100:00100000:1.0:1788201331.015298:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:1.0:1788201331.015309:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+10:14438:x1875064614144256:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788201331.015336:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201331.015363:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b788026 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3216 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.015605:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b78802d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.015622:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b78802d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.015634:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b78802d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.015649:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788034 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.015656:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788034 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.015663:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788034 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016263:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077800/0x72011f792b78803b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016275:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077800/0x72011f792b78803b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016284:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077800/0x72011f792b78803b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201331.016326:0:14469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1788201331.016330:0:14469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201331.016382:0:14469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077800/0x72011f792b78803b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016396:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b78802d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016404:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b78802d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016410:0:14469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b78802d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016533:0:14469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c077a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201331.016538:0:14469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b78802d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016547:0:14469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b78802d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016562:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0004dfd500) 00010000:00010000:1.0:1788201331.016573:0:14469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201331.016579:0:14469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b78802d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016586:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b78802d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016602:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788034 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016608:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788034 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016613:0:14469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788034 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016618:0:14469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c076a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201331.016620:0:14469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788034 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016625:0:14469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788034 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016632:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b0004dfd000) 00010000:00010000:1.0:1788201331.016634:0:14469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201331.016636:0:14469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788034 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016642:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788034 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016679:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b788026 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3216 expref: 12 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016706:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077800/0x72011f792b78803b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3216 expref: 11 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.016859:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b002df50e00) 00010000:00010000:1.0:1788201331.016862:0:14469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788201331.016865:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b003c077800, rc 0) 00000100:00100000:1.0:1788201331.017012:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+11:14438:x1875064614144256:12345-192.168.203.14@tcp:101:bash.0 Request processed in 1703us (2086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.017020:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:2.0:1788201331.025717:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201331.025859:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614144512 00000100:00100000:1.0:1788201331.025873:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614144512 00000100:00100000:1.0:1788201331.025952:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:1.0:1788201331.025965:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+11:14438:x1875064614144512:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788201331.026001:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201331.026031:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b788042 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d321d expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.026229:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788049 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.026248:0:14468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b78801f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d320f expref: 11 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.026259:0:14468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788049 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.026304:0:14468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b78801f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d320f expref: 11 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.026337:0:14468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b78801f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d320f expref: 11 pid: 15174 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.026353:0:14468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14468:1875064622517248:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201331.026535:0:14468:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0008b58180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201331.030680:0:14468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14468:1875064622517248:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201331.030782:0:14468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788049 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201331.037814:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201331.038303:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614144640 00000100:00100000:3.0:1788201331.038320:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614144640 00010000:00010000:3.0:1788201331.038382:0:14455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b78801f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d320f expref: 12 pid: 15174 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201331.038510:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:3.0:1788201331.038522:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc130956-7593-4d7c-b6a5-5684b4485823+12:2348:x1875064614144640:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201331.038542:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201331.038551:0:14455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b78801f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d320f expref: 12 pid: 15174 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.038566:0:14455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b78801f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d320f expref: 12 pid: 15174 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.038594:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b78801f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d320f expref: 12 pid: 15174 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.038613:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b002df50e00) 00010000:00010000:3.0:1788201331.038618:0:14455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788049 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.038630:0:14455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788049 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.038638:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788049 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.038676:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201331.038766:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc130956-7593-4d7c-b6a5-5684b4485823+11:2348:x1875064614144640:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 244us (976us total) trans 0 rc 0/0 00010000:00010000:1.0:1788201331.038780:0:14468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788049 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201331.038783:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00010000:00010000:1.0:1788201331.038789:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788049 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.038828:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b788050 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.038840:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b788050 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.038848:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b788050 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.042386:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076000/0x72011f792b788057 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.042414:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076000/0x72011f792b788057 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.042445:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076000/0x72011f792b788057 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201331.042462:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788201331.042502:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788049 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.042510:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788049 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.042517:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788049 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.042524:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c076a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201331.042529:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788049 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.042540:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788049 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.042554:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b002df50e00) 00010000:00010000:1.0:1788201331.042558:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201331.042563:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788049 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.042570:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788049 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201331.042587:0:14468:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bbc0d3a reply state 00000000a089a5e0 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b788050 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.042608:0:14468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201331.042903:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b788042 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d321d expref: 14 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.042923:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076000/0x72011f792b788057 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d321d expref: 13 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.042931:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:1.0:1788201331.042933:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788201331.042936:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b003c076000, rc 0) 00000100:00100000:1.0:1788201331.043042:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+14:14438:x1875064614144512:12345-192.168.203.14@tcp:101:bash.0 Request processed in 17079us (17349us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788201331.043053:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 28 00010000:00010000:0.0:1788201331.045772:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b788050 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.045799:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b788050 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.045841:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b788050 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.045849:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c077a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201331.045854:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b788050 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.045863:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b788050 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.045885:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9b0004dfd000) 00010000:00010000:0.0:1788201331.045889:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201331.045895:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b788050 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.045902:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b788050 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201331.054869:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201331.056093:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614144768 00000100:00100000:3.0:1788201331.056129:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614144768 00000100:00100000:2.0:1788201331.056377:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:2.0:1788201331.056625:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+13:14438:x1875064614144768:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:2.0:1788201331.056661:0:14470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201331.056690:0:14470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b788065 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3224 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.056781:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78806c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.056799:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78806c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.056824:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78806c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201331.056997:0:14470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788201331.057001:0:14470:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201331.057028:0:14470:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78806c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.057038:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78806c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.057062:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b788065 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3224 expref: 15 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.057081:0:14470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78806c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3224 expref: 14 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.057107:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:2.0:1788201331.057110:0:14470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201331.057114:0:14470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0e00, rc 0) 00000100:00100000:2.0:1788201331.057219:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+14:14438:x1875064614144768:12345-192.168.203.14@tcp:101:bash.0 Request processed in 600us (2365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201331.057227:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:2.0:1788201331.060759:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201331.063337:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614145024 00000100:00100000:3.0:1788201331.063359:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614145024 00000100:00100000:3.0:1788201331.063721:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:3.0:1788201331.063743:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+14:14438:x1875064614145024:12345-192.168.203.14@tcp:35:bash.0 00000100:00100000:3.0:1788201331.064730:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+15:14438:x1875064614145024:12345-192.168.203.14@tcp:35:bash.0 Request processed in 983us (3971us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788201331.064742:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:0.0:1788201331.135654:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201331.137640:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614145280 00000100:00100000:2.0:1788201331.137660:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614145280 00000100:00100000:2.0:1788201331.138516:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00100000:2.0:1788201331.138531:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+15:14448:x1875064614145280:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788201331.138563:0:15174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201331.138589:0:15174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b788073 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d322b expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201331.138828:0:15174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788201331.138996:0:15174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b788073 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d322b expref: 17 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.139014:0:15174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0004dfd500) 00010000:00010000:2.0:1788201331.139017:0:15174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201331.139021:0:15174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b788073 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d322b expref: 17 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.139038:0:15174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1a00, rc 0) 00000100:00100000:2.0:1788201331.139409:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+16:14448:x1875064614145280:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 879us (3768us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788201331.139434:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00100000:2.0:1788201331.144779:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201331.145018:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614145536 00000100:00100000:1.0:1788201331.145033:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614145536 00000100:00100000:1.0:1788201331.145199:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:1.0:1788201331.145212:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+16:14448:x1875064614145536:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788201331.146114:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+17:14448:x1875064614145536:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 897us (1343us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788201331.146126:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:3.0:1788201331.186434:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201331.188382:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614145792 00000100:00100000:1.0:1788201331.188401:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614145792 00000100:00100000:1.0:1788201331.188496:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 31 00000100:00100000:1.0:1788201331.188509:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+17:14451:x1875064614145792:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788201331.188542:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201331.188588:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b788081 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3232 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.188724:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788088 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.188741:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788088 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.188753:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788088 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201331.188767:0:14469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788201331.188942:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b788081 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3232 expref: 20 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.188966:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788088 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3232 expref: 19 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.188976:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:1.0:1788201331.188980:0:14469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201331.188984:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b003c076a00, rc 0) 00000100:00100000:1.0:1788201331.189906:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+19:14451:x1875064614145792:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1390us (3478us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788201331.189916:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 31 00000100:00100000:0.0:1788201331.193367:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201331.193422:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201331.193639:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614145920 00000100:00100000:1.0:1788201331.193652:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614145920 00000100:00100000:3.0:1788201331.193686:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614146048 00000100:00100000:3.0:1788201331.193692:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614146048 00000100:00100000:3.0:1788201331.193741:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:3.0:1788201331.193753:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+20:2349:x1875064614146048:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201331.193773:0:14454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201331.193817:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b788088 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3232 expref: 20 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201331.193841:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:3.0:1788201331.193846:0:14454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201331.193921:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+19:2349:x1875064614146048:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 170us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201331.193930:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:1.0:1788201331.193931:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:1.0:1788201331.193939:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+19:14451:x1875064614145920:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:1.0:1788201331.194035:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b788096 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.194051:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b788096 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.194064:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b788096 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.194099:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b788096 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.194108:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b788096 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.194113:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b788096 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.194119:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c077000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201331.194123:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b788096 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.194165:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b788096 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.194175:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:1.0:1788201331.194178:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201331.194182:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b788096 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.194188:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b788096 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.194363:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+18:14451:x1875064614145920:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 424us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.194370:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:3.0:1788201331.199884:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201331.200119:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614146304 00000100:00100000:2.0:1788201331.200169:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614146304 00000100:00100000:2.0:1788201331.200519:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:2.0:1788201331.200532:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+18:14451:x1875064614146304:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:2.0:1788201331.201027:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+19:14451:x1875064614146304:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 496us (1240us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788201331.201036:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:2.0:1788201331.426404:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201331.426526:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614146560 00000100:00100000:0.0:1788201331.426539:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614146560 00000100:00100000:0.0:1788201331.426639:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:0.0:1788201331.426652:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+19:14482:x1875064614146560:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:0.0:1788201331.426686:0:14470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201331.426714:0:14470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b78809d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3239 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.426889:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7880a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.426907:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7880a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.426921:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7880a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201331.426935:0:14470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788201331.427125:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b78809d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3239 expref: 22 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.427194:0:14470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7880a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3239 expref: 21 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.427204:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:0.0:1788201331.427208:0:14470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201331.427584:0:14470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b000676f800, rc 0) 00000100:00100000:0.0:1788201331.427669:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+21:14482:x1875064614146560:12345-192.168.203.14@tcp:101:cat.0 Request processed in 1019us (1289us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788201331.427678:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:3.0:1788201331.437175:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201331.437450:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614146688 00000100:00100000:1.0:1788201331.437472:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614146688 00000100:00100000:1.0:1788201331.437556:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:1.0:1788201331.437568:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+21:2348:x1875064614146688:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201331.437589:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201331.437623:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676f800/0x72011f792b7880a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3239 expref: 21 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.437647:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:1.0:1788201331.437654:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201331.437727:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+20:2348:x1875064614146688:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 162us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.437736:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:3.0:1788201331.438096:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201331.438313:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614146944 00000100:00100000:0.0:1788201331.438320:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614146944 00000100:00100000:0.0:1788201331.438360:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:0.0:1788201331.438369:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+20:14482:x1875064614146944:12345-192.168.203.14@tcp:35:cat.0 00000100:00100000:0.0:1788201331.438773:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+21:14482:x1875064614146944:12345-192.168.203.14@tcp:35:cat.0 Request processed in 404us (676us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788201331.438811:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:3.0:1788201331.505989:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201331.507416:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614147200 00000100:00100000:1.0:1788201331.507435:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614147200 00000100:00100000:1.0:1788201331.507524:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:1.0:1788201331.507536:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+21:14488:x1875064614147200:12345-192.168.203.14@tcp:101:dd.0 00010000:00010000:1.0:1788201331.507572:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201331.507612:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b7880b2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3240 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.507760:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b7880b9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.507793:0:14468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076000/0x72011f792b788057 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d321d expref: 22 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.507811:0:14468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78806c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3224 expref: 22 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.507821:0:14468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b7880b9 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.507867:0:14468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78806c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3224 expref: 22 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.507882:0:14468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78806c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3224 expref: 22 pid: 14470 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.507899:0:14468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14468:1875064622517376:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201331.508048:0:14468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076000/0x72011f792b788057 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d321d expref: 22 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.508059:0:14468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076000/0x72011f792b788057 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d321d expref: 22 pid: 14468 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.508070:0:14468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14468:1875064622517504:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201331.508097:0:14468:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0008b58b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201331.510349:0:14468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14468:1875064622517376:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788201331.510370:0:14468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14468:1875064622517504:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788201331.510450:0:14468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b7880b9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201331.513084:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201331.513198:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201331.513867:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614147328 00000100:00100000:1.0:1788201331.513880:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614147328 00010000:00010000:1.0:1788201331.513940:0:14455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78806c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3224 expref: 23 pid: 14470 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.513983:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614147456 00000100:00100000:1.0:1788201331.513987:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614147456 00010000:00010000:1.0:1788201331.514004:0:14455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076000/0x72011f792b788057 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d321d expref: 24 pid: 14468 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.514022:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:1.0:1788201331.514032:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0003eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+24:2349:x1875064614147328:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201331.514052:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201331.514061:0:14455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78806c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3224 expref: 24 pid: 14470 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.514076:0:14455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78806c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3224 expref: 24 pid: 14470 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.514106:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b78806c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3224 expref: 24 pid: 14470 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.514127:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:1.0:1788201331.514191:0:14455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b7880b9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.514217:0:14455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b7880b9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.514225:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201331.514296:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0003eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+23:2349:x1875064614147328:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 264us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.514304:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:1.0:1788201331.514493:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:1.0:1788201331.514501:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+22:2349:x1875064614147456:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201331.514510:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201331.514516:0:14455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076000/0x72011f792b788057 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d321d expref: 22 pid: 14468 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.514527:0:14455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076000/0x72011f792b788057 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d321d expref: 22 pid: 14468 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.514540:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076000/0x72011f792b788057 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d321d expref: 22 pid: 14468 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.514552:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:1.0:1788201331.514556:0:14455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b7880b9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.514564:0:14455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b7880b9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.514573:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b7880b9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.514605:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201331.514626:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+21:2349:x1875064614147456:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 126us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.514633:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 12 00010000:00010000:1.0:1788201331.514659:0:14468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b7880b9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.514667:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b7880b9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201331.514690:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788201331.514908:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b7880b2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3240 expref: 22 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.514926:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077c00/0x72011f792b7880b9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3240 expref: 21 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.514934:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:1.0:1788201331.514937:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788201331.514940:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b003c077c00, rc 0) 00000100:00100000:1.0:1788201331.514969:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+21:14488:x1875064614147200:12345-192.168.203.14@tcp:101:dd.0 Request processed in 7436us (8996us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788201331.514976:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:0.0:1788201331.519847:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201331.520012:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614147712 00000100:00100000:1.0:1788201331.520024:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614147712 00000100:00100000:1.0:1788201331.520112:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:1.0:1788201331.520122:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+21:14488:x1875064614147712:12345-192.168.203.14@tcp:36:dd.0 00010000:00010000:1.0:1788201331.520663:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b7880c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.520685:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b7880c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.520697:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b7880c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201331.520763:0:14469:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788201331.520975:0:14469:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c4cf341 reply state 00000000e9adad34 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b7880c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201331.520987:0:14469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201331.521109:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+24:14488:x1875064614147712:12345-192.168.203.14@tcp:36:dd.0 Request processed in 985us (1276us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788201331.521117:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 35 00000020:00080000:1.0:1788201331.521122:0:14469:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788201331.524899:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201331.525058:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614147840 00000100:00100000:2.0:1788201331.525070:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614147840 00000100:00100000:2.0:1788201331.525172:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 36 00000100:00100000:2.0:1788201331.525185:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+24:14488:x1875064614147840:12345-192.168.203.14@tcp:101:dd.0 00010000:00010000:2.0:1788201331.525216:0:15174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201331.525242:0:15174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7880ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3247 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.525320:0:15174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7880ce lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3247 expref: 25 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.525351:0:15174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7880ce lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3247 expref: 25 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201331.525375:0:15174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:2.0:1788201331.525379:0:15174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201331.525392:0:15174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0e00, rc 0) 00000100:00100000:2.0:1788201331.525463:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+25:14488:x1875064614147840:12345-192.168.203.14@tcp:101:dd.0 Request processed in 281us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201331.525470:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 36 00010000:00010000:0.0:1788201331.529396:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b7880c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.529420:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b7880c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.529429:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b7880c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.529436:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c077a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201331.529442:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b7880c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.529451:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b7880c7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.529536:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:0.0:1788201331.529541:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201331.529547:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b7880c7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.529555:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077a00/0x72011f792b7880c7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201331.546994:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201331.547186:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614148096 00000100:00100000:1.0:1788201331.547199:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614148096 00000100:00100000:1.0:1788201331.547315:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:1.0:1788201331.547330:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+24:14488:x1875064614148096:12345-192.168.203.14@tcp:103:dd.0 00010000:00010000:1.0:1788201331.547351:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201331.547396:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b7880ce lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3247 expref: 24 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.547421:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:1.0:1788201331.547428:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201331.547533:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+23:14488:x1875064614148096:12345-192.168.203.14@tcp:103:dd.0 Request processed in 207us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.547542:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:3.0:1788201331.550473:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201331.550585:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614148224 00000100:00100000:0.0:1788201331.550597:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614148224 00000100:00100000:0.0:1788201331.550811:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 37 00000100:00100000:0.0:1788201331.550825:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+23:14488:x1875064614148224:12345-192.168.203.14@tcp:58:dd.0 00010000:00010000:0.0:1788201331.550992:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b7880d5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.551015:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b7880d5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201331.551029:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b7880d5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201331.551973:0:14470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201331.552197:0:14470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788201331.552290:0:14470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788201331.552442:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+23:14488:x1875064614148224:12345-192.168.203.14@tcp:58:dd.0 Request processed in 1614us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201331.552453:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 37 00000100:00100000:2.0:1788201331.556466:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201331.556575:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614148352 00000100:00100000:1.0:1788201331.556588:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614148352 00000100:00100000:1.0:1788201331.556773:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 38 00000100:00100000:1.0:1788201331.556786:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+23:14488:x1875064614148352:12345-192.168.203.14@tcp:101:dd.0 00010000:00010000:1.0:1788201331.556994:0:15174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201331.557025:0:15174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b7880dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d324e expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.557101:0:15174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b7880d5 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.557114:0:15174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b7880dc lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d324e expref: 24 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.557160:0:15174:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b7880d5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.557249:0:15174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b7880dc lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d324e expref: 24 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.557266:0:15174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:1.0:1788201331.557270:0:15174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201331.557275:0:15174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b7880dc lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d324e expref: 24 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201331.557284:0:15174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b003c077000, rc 0) 00000100:00100000:1.0:1788201331.557427:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+24:14488:x1875064614148352:12345-192.168.203.14@tcp:101:dd.0 Request processed in 642us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.557435:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 38 00010000:00010000:0.0:1788201331.662173:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788201331.979830:0:14499:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788201331.979842:0:14499:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788201331.979914:0:14499:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788201331.979923:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788201331.980091:0:14499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f617b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14499:1875064622517632:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788201331.980388:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b0035f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622517760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201331.980449:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201331.980811:0:14499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0015d97240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201331.981098:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622518144:0@lo:400:kworker.0 00000100:00100000:1.0:1788201331.981167:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201331.981191:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201331.981197:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622518272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201331.981221:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201331.981293:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3294:1875064622517888:0@lo:400:kworker.0 00000100:00100000:0.0:1788201331.981341:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201331.981369:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1875064622518400:0@lo:400:kworker.0 00000100:00100000:0.0:1788201331.981390:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201331.981406:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201331.981411:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b002722ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622518016:0@lo:400:kworker.0 00000100:00100000:0.0:1788201331.981435:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201331.981493:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622518016 00000100:00100000:0.0:1788201331.981502:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622518016 00000100:00100000:0.0:1788201331.981573:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201331.981594:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622518016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201331.981656:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1875064622518016:12345-0@lo:400:kworker.0 Request processed in 67us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201331.981663:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788201331.981688:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201331.981936:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622517888 00000100:00100000:1.0:1788201331.981941:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622517888 00000100:00100000:1.0:1788201331.981975:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788201331.981982:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:3294:x1875064622517888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201331.982023:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9+19:3294:x1875064622517888:12345-0@lo:400:kworker.0 Request processed in 41us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.982029:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788201331.982081:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622518144 00000100:00100000:1.0:1788201331.982085:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622518144 00000100:00100000:1.0:1788201331.982119:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622518272 00000100:00100000:1.0:1788201331.982128:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622518272 00000100:00100000:1.0:1788201331.982178:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622518400 00000100:00100000:1.0:1788201331.982181:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622518400 00000100:00100000:1.0:1788201331.982196:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788201331.982201:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622518144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201331.982237:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875064622518144:12345-0@lo:400:kworker.0 Request processed in 35us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.982243:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788201331.982268:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875064622518144:0@lo:400:kworker.0 00000100:00100000:1.0:1788201331.982316:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201331.982334:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622518272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201331.982368:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875064622518272:12345-0@lo:400:kworker.0 Request processed in 47us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.982374:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201331.982395:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1875064622518272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201331.982437:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201331.982444:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875064622518400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201331.982474:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875064622518400:12345-0@lo:400:kworker.0 Request processed in 31us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201331.982480:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788201331.982505:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201331.982675:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1875064622518016:0@lo:400:kworker.0 00000100:00100000:0.0:1788201331.982691:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4d28e1-8c0c-41fb-aa77-6aa504cbd5c9:3294:1875064622517888:0@lo:400:kworker.0 00000100:00100000:0.0:1788201331.982702:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b002722c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1875064622518400:0@lo:400:kworker.0 00000100:00100000:3.0:1788201331.983561:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622517760 00000100:00100000:3.0:1788201331.983569:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622517760 00000100:00100000:3.0:1788201331.983621:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201331.983630:0:15154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622517760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201331.983673:0:15154:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201331.983751:0:15154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622517760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (3302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201331.983758:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788201331.983781:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201331.983835:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b0035f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622517760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201331.984574:0:3295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622518528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201331.984641:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201331.987130:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622518528 00000100:00100000:3.0:1788201331.987188:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622518528 00000100:00100000:3.0:1788201331.987522:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201331.987533:0:15154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622518528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201331.987572:0:15154:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201331.987668:0:15154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875064622518528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (3028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201331.987676:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201331.988095:0:3295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1875064622518528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201331.996105:0:14499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f617b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14499:1875064622517632:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788201332.000235:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201332.000289:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201332.000326:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201332.000438:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614148736 00000100:00100000:3.0:1788201332.000454:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614148736 00000100:00100000:3.0:1788201332.000549:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:3.0:1788201332.000561:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+5:2350:x1875064614148736:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788201332.000675:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+5:2350:x1875064614148736:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 116us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201332.000712:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:2.0:1788201332.000713:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614148608 00000100:00100000:2.0:1788201332.000726:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614148608 00000100:00100000:2.0:1788201332.000785:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 122 00000100:00100000:2.0:1788201332.000808:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b001f924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+13:2350:x1875064614148608:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788201332.000878:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b001f924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6907c23-6974-4cbd-b040-4be99751a9b0+13:2350:x1875064614148608:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 84us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201332.000886:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 122 00000100:00080000:1.0:1788201332.001099:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201332.001700:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614148480 00000100:00100000:0.0:1788201332.001709:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614148480 00000100:00100000:0.0:1788201332.001774:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:0.0:1788201332.001785:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+24:14489:x1875064614148480:12345-192.168.203.14@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788201332.001849:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+24:14489:x1875064614148480:12345-192.168.203.14@tcp:900:lhsmtool_posix.0 Request processed in 67us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201332.001857:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00080000:1.0:1788201332.002623:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201332.003231:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201332.003259:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201332.003430:0:15152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614148864 00000100:00100000:0.0:1788201332.003438:0:15152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614148864 00000100:00100000:0.0:1788201332.003490:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:0.0:1788201332.003501:0:15152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+5:2350:x1875064614148864:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201332.003556:0:15152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+5:2350:x1875064614148864:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 59us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201332.003563:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00080000:1.0:1788201332.005079:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201332.007921:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614148992 00000100:00100000:0.0:1788201332.007960:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614148992 00000100:00100000:0.0:1788201332.008070:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:0.0:1788201332.008084:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc130956-7593-4d7c-b6a5-5684b4485823+11:2350:x1875064614148992:12345-192.168.203.14@tcp:400:kworker.0 00000100:00080000:1.0:1788201332.008450:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201332.009803:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201332.010954:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201332.012762:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc130956-7593-4d7c-b6a5-5684b4485823+11:2350:x1875064614148992:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 4662us (9481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201332.012784:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:1.0:1788201332.016906:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201332.017021:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614149376 00000100:00100000:3.0:1788201332.017032:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614149376 00000100:00100000:3.0:1788201332.017090:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:3.0:1788201332.017100:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+24:14489:x1875064614149376:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788201332.017151:0:14469:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788201332.017274:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+24:14489:x1875064614149376:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 176us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201332.017282:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:2.0:1788201332.019091:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614149248 00000100:00100000:2.0:1788201332.019105:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614149248 00000100:00080000:1.0:1788201332.019339:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201332.019465:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614149120 00000100:00100000:2.0:1788201332.019469:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614149120 00000100:00080000:1.0:1788201332.019523:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201332.019608:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:0.0:1788201332.019622:0:15152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc130956-7593-4d7c-b6a5-5684b4485823+5:2351:x1875064614149248:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201332.019716:0:15152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc130956-7593-4d7c-b6a5-5684b4485823+5:2351:x1875064614149248:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 98us (9928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201332.019723:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:0.0:1788201332.019740:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:0.0:1788201332.019748:0:15152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc130956-7593-4d7c-b6a5-5684b4485823+5:2351:x1875064614149120:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788201332.019773:0:15152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc130956-7593-4d7c-b6a5-5684b4485823+5:2351:x1875064614149120:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 27us (8827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201332.019779:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:1.0:1788201332.026868:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201332.026984:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614149504 00000100:00100000:2.0:1788201332.027001:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614149504 00000100:00100000:2.0:1788201332.027065:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:2.0:1788201332.027075:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b002722ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+24:14489:x1875064614149504:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788201332.027200:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7880e3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027444:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7880e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027460:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7880e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027518:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7880ea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027527:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7880ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027533:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7880ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027555:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7880f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027564:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7880f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027570:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7880f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201332.027625:0:14470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788201332.027628:0:14470:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201332.027651:0:14470:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7880f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027662:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7880e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027667:0:14470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7880e3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027674:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7880e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027679:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201332.027683:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7880e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027689:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7880e3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027700:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b0004dfd900) 00010000:00010000:2.0:1788201332.027703:0:14470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201332.027707:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7880e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027713:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b7880e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027726:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7880ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027730:0:14470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7880ea lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027735:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7880ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027746:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201332.027748:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7880ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027755:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7880ea lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027762:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9b0011cb3300) 00010000:00010000:2.0:1788201332.027764:0:14470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201332.027767:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7880ea lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027772:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b7880ea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027785:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7880f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027790:0:14470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7880f1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027804:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7880f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027808:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201332.027811:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7880f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027817:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7880f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027835:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:2.0:1788201332.027837:0:14470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201332.027840:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7880f1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.027847:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b7880f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201332.028063:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b002722ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+24:14489:x1875064614149504:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 Request processed in 988us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201332.028072:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:1.0:1788201332.035778:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201332.035871:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614149760 00000100:00100000:3.0:1788201332.035882:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614149760 00000100:00100000:3.0:1788201332.035940:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 41 00000100:00100000:3.0:1788201332.035950:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+24:14489:x1875064614149760:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201332.035970:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201332.035989:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b7880f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3255 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.036086:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3200/0x72011f792b7880ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.036102:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3200/0x72011f792b7880ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.036115:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3200/0x72011f792b7880ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201332.036125:0:14469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788201332.036571:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3200/0x72011f792b7880ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.036581:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3200/0x72011f792b7880ff lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.036588:0:14469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3200/0x72011f792b7880ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.036594:0:14469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d3200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201332.036609:0:14469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3200/0x72011f792b7880ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.036617:0:14469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3200/0x72011f792b7880ff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.036630:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:3.0:1788201332.036633:0:14469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201332.036637:0:14469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3200/0x72011f792b7880ff lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.036644:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3200/0x72011f792b7880ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.036687:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b7880f8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3255 expref: 26 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.036698:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b0004dfd900) 00010000:00010000:3.0:1788201332.036700:0:14469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201332.036703:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b7880f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3255 expref: 26 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.036722:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aff030d3c00, rc 0) 00000100:00100000:3.0:1788201332.036779:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+25:14489:x1875064614149760:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 830us (1010us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1788201332.036787:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 41 00000100:00100000:1.0:1788201332.044266:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201332.044426:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614149888 00000100:00100000:2.0:1788201332.044437:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614149888 00000100:00100000:2.0:1788201332.044498:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:2.0:1788201332.044508:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+25:14489:x1875064614149888:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788201332.044542:0:14470:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788201332.044655:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+25:14489:x1875064614149888:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 148us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201332.044663:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:0.0:1788201332.047493:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201332.048777:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614150144 00000100:00100000:3.0:1788201332.048801:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614150144 00000100:00100000:3.0:1788201332.048891:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:3.0:1788201332.048905:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+25:14489:x1875064614150144:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201332.048939:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201332.048981:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b78810d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d325c expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201332.053345:0:14469:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:2.0:1788201332.053363:0:14469:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788201332.053421:0:14469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788201332.053840:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b788114 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.053861:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b788114 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.053891:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b788114 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.053989:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3c00/0x72011f792b78810d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d325c expref: 28 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.054014:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b788114 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d325c expref: 27 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.054026:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b0011cb3300) 00010000:00010000:2.0:1788201332.054029:0:14469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201332.054034:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f1a00, rc 0) 00000100:00100000:2.0:1788201332.054203:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+27:14489:x1875064614150144:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 5299us (6722us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788201332.054214:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:1.0:1788201332.061926:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201332.063204:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614150400 00000100:00100000:2.0:1788201332.063230:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614150400 00000100:00100000:2.0:1788201332.063312:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:2.0:1788201332.063322:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004052f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+27:14489:x1875064614150400:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788201332.063420:0:14470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201332.063454:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1a00/0x72011f792b788114 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d325c expref: 27 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063477:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b0011cb3300) 00010000:00010000:2.0:1788201332.063490:0:14470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201332.063519:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b788122 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063552:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b788122 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063564:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b788122 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063582:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b788129 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x43a0d8e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063594:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b788129 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x43a0d8e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063601:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b788129 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x43a0d8e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063702:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b788122 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063711:0:14470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b788122 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063718:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b788122 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063724:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201332.063729:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b788122 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063738:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b788122 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063747:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b002df50e00) 00010000:00010000:2.0:1788201332.063756:0:14470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201332.063762:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b788122 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063768:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b788122 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063778:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b788129 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x43a0d8e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063785:0:14470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b788129 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x43a0d8e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063791:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b788129 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x43a0d8e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063810:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201332.063813:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b788129 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x43a0d8e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063819:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b788129 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x43a0d8e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063826:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x43a0d8e3 (ffff9b0011cb3900) 00010000:00010000:2.0:1788201332.063828:0:14470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201332.063831:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b788129 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x43a0d8e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.063836:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0000/0x72011f792b788129 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x43a0d8e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201332.063949:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004052f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+26:14489:x1875064614150400:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 627us (2039us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201332.063964:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:1.0:1788201332.067812:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201332.068009:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614150528 00000100:00100000:2.0:1788201332.068021:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614150528 00000100:00100000:2.0:1788201332.068103:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:2.0:1788201332.068115:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003b0af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+26:14489:x1875064614150528:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201332.068190:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201332.068222:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788130 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3263 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.068275:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b788137 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.068301:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b788137 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.068318:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b788137 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.068463:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788130 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3263 expref: 28 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.068487:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0e00/0x72011f792b788137 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3263 expref: 27 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.068497:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b0011cb3b00) 00010000:00010000:2.0:1788201332.068500:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788201332.068505:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0e00, rc 0) 00000100:00100000:2.0:1788201332.068572:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003b0af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+27:14489:x1875064614150528:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 458us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201332.068597:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:0.0:1788201332.075374:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201332.075483:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614150784 00000100:00100000:1.0:1788201332.075495:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614150784 00000100:00100000:1.0:1788201332.075568:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:1.0:1788201332.075580:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+27:14489:x1875064614150784:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788201332.075722:0:15174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b78813e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.075744:0:15174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b78813e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.075757:0:15174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b78813e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201332.077686:0:15174:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1788201332.077711:0:15174:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 411202576067ns, next at 412202572354ns, rc = 0 00000004:00010000:1.0:1788201332.077878:0:15174:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041f2be56 reply state 00000000feb55307 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b78813e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201332.077892:0:15174:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201332.078951:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+29:14489:x1875064614150784:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 3362us (3582us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788201332.078975:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:1.0:1788201332.083191:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201332.083300:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614150912 00000100:00100000:2.0:1788201332.083313:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614150912 00000100:00100000:2.0:1788201332.083395:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 47 00000100:00100000:2.0:1788201332.083407:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+29:14489:x1875064614150912:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201332.083441:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201332.083468:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788145 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d326a expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.083549:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788145 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d326a expref: 30 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.083569:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788145 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d326a expref: 30 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.083603:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b0011cb3b00) 00010000:00010000:2.0:1788201332.083607:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201332.083611:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b001f8f0600, rc 0) 00000100:00100000:2.0:1788201332.083706:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+30:14489:x1875064614150912:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 300us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201332.083714:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 47 00010000:00010000:0.0:1788201332.086057:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b78813e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.086080:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b78813e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.086089:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b78813e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.086147:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b003c076a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1788201332.086155:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b78813e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.086164:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b78813e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.086185:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b0011cb3b00) 00010000:00010000:0.0:1788201332.086188:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201332.086194:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b78813e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.086201:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076a00/0x72011f792b78813e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201332.087344:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201332.087513:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614151040 00000100:00100000:2.0:1788201332.087526:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614151040 00000100:00100000:2.0:1788201332.087602:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:2.0:1788201332.087615:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+5:2351:x1875064614151040:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788201332.088446:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:2351:x1875064614151040:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 827us (1107us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788201332.088472:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:3.0:1788201332.090760:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201332.090829:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614151296 00000100:00100000:0.0:1788201332.090842:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614151296 00000100:00100000:0.0:1788201332.090921:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:0.0:1788201332.090933:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+29:14489:x1875064614151296:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788201332.091358:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+30:14489:x1875064614151296:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 424us (610us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788201332.091367:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:1.0:1788201332.101807:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201332.101925:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614151552 00000100:00100000:2.0:1788201332.101938:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614151552 00000100:00100000:2.0:1788201332.102778:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:2.0:1788201332.102804:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+30:14489:x1875064614151552:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788201332.103647:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+30:14489:x1875064614151552:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 850us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201332.103658:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:2.0:1788201332.112581:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201332.112957:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614151680 00000100:00100000:1.0:1788201332.113058:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614151680 00000100:00100000:1.0:1788201332.113217:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:1.0:1788201332.113230:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+30:14489:x1875064614151680:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201332.113259:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201332.113287:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076000/0x72011f792b78814c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3271 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.113386:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077600/0x72011f792b788153 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.113404:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077600/0x72011f792b788153 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.113418:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077600/0x72011f792b788153 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201332.113468:0:14468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201332.113492:0:14468:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077600/0x72011f792b788153 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.113526:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c076000/0x72011f792b78814c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3271 expref: 32 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.113546:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077600/0x72011f792b788153 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3271 expref: 31 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.113556:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b0011cb3b00) 00010000:00010000:1.0:1788201332.113558:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788201332.113562:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b003c077600, rc 0) 00000100:00100000:1.0:1788201332.113650:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+31:14489:x1875064614151680:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 424us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201332.113668:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:2.0:1788201332.116921:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201332.117130:0:15152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614151808 00000100:00100000:3.0:1788201332.117175:0:15152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614151808 00000100:00100000:3.0:1788201332.117238:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:3.0:1788201332.117250:0:15152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:2349:x1875064614151808:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201332.117273:0:15152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201332.117298:0:15152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b78815a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d3278 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201332.117332:0:15152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95c973, blocks: 0x1 00010000:00010000:3.0:1788201332.117356:0:15152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=411s v=(0 0) 00010000:00010000:3.0:1788201332.117361:0:15152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201332.117372:0:15152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b78815a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3278 expref: 7 pid: 15152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.117412:0:15152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b78815a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3278 expref: 7 pid: 15152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.117429:0:15152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aff030d3200, rc 0) 00000100:00100000:3.0:1788201332.117503:0:15152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+7:2349:x1875064614151808:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 255us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201332.117511:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:3.0:1788201332.120882:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201332.120983:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614152064 00000100:00100000:1.0:1788201332.120996:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614152064 00000100:00100000:1.0:1788201332.121072:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 50 00000100:00100000:1.0:1788201332.121085:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+31:14489:x1875064614152064:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788201332.121508:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+31:14489:x1875064614152064:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 424us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201332.121517:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 50 00000100:00100000:3.0:1788201332.124394:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788201332.124508:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614152192 00000100:00100000:0.0:1788201332.124520:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614152192 00000100:00100000:0.0:1788201332.124590:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00100000:0.0:1788201332.124602:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+31:14489:x1875064614152192:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788201332.171192:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1788201332.171242:0:5849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788201332.171292:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:3.0:1788201332.171310:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1788201332.171327:0:5849:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1788201332.171545:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+14:14489:x1875064614152192:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 Request processed in 46937us (47157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201332.171559:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00100000:3.0:1788201332.172398:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201332.172422:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622518656:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788201332.172496:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201332.172879:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622518656 00000100:00100000:2.0:1788201332.172889:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622518656 00000100:00100000:2.0:1788201332.172951:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788201332.173075:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875064622518656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788201332.173350:0:15151:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788201332.173354:0:15151:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788201332.173358:0:15151:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788201332.173360:0:15151:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788201331 -> 1788201331 00002000:00010000:2.0:1788201332.173363:0:15151:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788201332.173429:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3293:x1875064622518656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 468us (931us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788201332.173437:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:3.0:1788201332.173574:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b003f615500/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788201332.173582:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1875064622518656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788201332.175600:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201332.175867:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614152320 00000100:00100000:3.0:1788201332.175879:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614152320 00000100:00100000:3.0:1788201332.175946:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:3.0:1788201332.175958:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+7:2348:x1875064614152320:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788201332.176216:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+7:2348:x1875064614152320:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 Request processed in 259us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201332.176243:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:3.0:1788201332.178514:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201332.178680:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614152576 00000100:00100000:2.0:1788201332.178692:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614152576 00000100:00100000:2.0:1788201332.178772:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:2.0:1788201332.178809:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+14:14489:x1875064614152576:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788201332.180074:0:14470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201332.180120:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077600/0x72011f792b788153 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3271 expref: 14 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.180278:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b0011cb3b00) 00010000:00010000:2.0:1788201332.180284:0:14470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201332.180331:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788161 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.180349:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788161 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.180360:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788161 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201332.180630:0:14470:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038e0a939 reply state 00000000423d8438 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788161 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201332.180641:0:14470:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201332.180791:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+15:14489:x1875064614152576:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 1993us (2288us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788201332.180811:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:3.0:1788201332.184209:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201332.184251:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614152704 00000100:00100000:3.0:1788201332.184262:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614152704 00000100:00100000:3.0:1788201332.184321:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:3.0:1788201332.184331:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+7:14489:x1875064614152704:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201332.184356:0:15151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201332.184379:0:15151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b788168 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f12878c8e1d327f expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.184418:0:15151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b78815a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3278 expref: 8 pid: 15152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.184428:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201332.184434:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201332.184440:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b788168 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d327f expref: 8 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.184479:0:15151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b78815a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3278 expref: 8 pid: 15152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.184494:0:15151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b78815a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3278 expref: 8 pid: 15152 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201332.184539:0:15151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f436300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15151:1875064622518784:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788201332.184698:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788161 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.184708:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788161 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.184716:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788161 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.184732:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1788201332.184737:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788161 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.184745:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788161 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.184763:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b0011cb3b00) 00010000:00010000:2.0:1788201332.184767:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201332.184772:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788161 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.184779:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788161 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201332.185861:0:15151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010a09d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201332.189272:0:15151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f436300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15151:1875064622518784:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788201332.189317:0:15151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b788168 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d327f expref: 8 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.189346:0:15151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aff030d3a00, rc 0) 00000100:00100000:2.0:1788201332.189421:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+8:14489:x1875064614152704:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 5091us (5225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201332.189431:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:3.0:1788201332.190237:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201332.190319:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614152832 00000100:00100000:2.0:1788201332.190328:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614152832 00010000:00010000:2.0:1788201332.190374:0:14454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b78815a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3278 expref: 8 pid: 15152 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201332.190438:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:2.0:1788201332.190450:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f436a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+8:2348:x1875064614152832:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201332.190468:0:14454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201332.190496:0:14454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b78815a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3278 expref: 8 pid: 15152 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.190511:0:14454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b78815a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3278 expref: 8 pid: 15152 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.190538:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c1465d7/0x72011f792b78815a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d3278 expref: 8 pid: 15152 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.190557:0:14454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201332.190562:0:14454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201332.190570:0:14454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b788168 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d327f expref: 7 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.190591:0:14454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b788168 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d327f expref: 7 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.190635:0:14454:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b788168 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d327f expref: 7 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201332.190666:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f615f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14454:1875064622518912:192.168.203.14@tcp:105: 00000100:00100000:2.0:1788201332.190748:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8c1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201332.195907:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201332.195999:0:15152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614152960 00000100:00100000:3.0:1788201332.196013:0:15152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614152960 00000100:00100000:3.0:1788201332.196086:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:3.0:1788201332.196098:0:15152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+8:2349:x1875064614152960:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788201332.196377:0:15152:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788201332.196381:0:15152:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788201331 00002000:00010000:3.0:1788201332.196384:0:15152:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788201330 00002000:00010000:3.0:1788201332.196385:0:15152:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788201331 -> 1788201331 00002000:00010000:3.0:1788201332.196387:0:15152:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788201332.196461:0:15152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+9:2349:x1875064614152960:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 365us (570us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788201332.196469:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:2.0:1788201332.200049:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201332.200210:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614153088 00000100:00100000:3.0:1788201332.200225:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614153088 00000100:00100000:0.0:1788201332.200288:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f615f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14454:1875064622518912:192.168.203.14@tcp:105: 00000100:00100000:3.0:1788201332.200293:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:3.0:1788201332.200303:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b003f614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+9:2351:x1875064614153088:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788201332.200330:0:14454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201332.200359:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b78816f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.200382:0:15151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b788168 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d327f expref: 9 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.200421:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201332.200426:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201332.200431:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b78816f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.200474:0:15151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b788168 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d327f expref: 9 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.200489:0:15151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b788168 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d327f expref: 9 pid: 15151 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201332.200507:0:15151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f434380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15151:1875064622519040:192.168.203.14@tcp:104: 00000100:00100000:3.0:1788201332.200625:0:15151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0010a096c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201332.201088:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f436a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+9:2348:x1875064614152832:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 10636us (10852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201332.201099:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:1.0:1788201332.204388:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201332.204512:0:15151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f434380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15151:1875064622519040:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788201332.204546:0:15151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b78816f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201332.204792:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614153216 00000100:00100000:0.0:1788201332.204810:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614153216 00010000:00010000:0.0:1788201332.204862:0:14453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b788168 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d327f expref: 9 pid: 15151 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201332.204908:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:0.0:1788201332.204920:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+9:2348:x1875064614153216:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201332.204939:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201332.204979:0:14453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b788168 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d327f expref: 9 pid: 15151 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.204994:0:14453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b788168 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d327f expref: 9 pid: 15151 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.205027:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c47fde0a/0x72011f792b788168 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d327f expref: 9 pid: 15151 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.205045:0:14453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788201332.205050:0:14453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788201332.205057:0:14453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b78816f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.205069:0:14453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b78816f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.205121:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201332.205244:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+8:2348:x1875064614153216:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 326us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201332.205252:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 14 00010000:00010000:3.0:1788201332.205673:0:15151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b78816f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.205684:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b78816f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.205714:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b78816f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.205733:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b78816f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.205742:0:15151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b78816f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.205751:0:15151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d3800 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201332.205756:0:15151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b78816f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.205766:0:15151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b78816f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.205778:0:15151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b78816f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.205785:0:15151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b78816f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201332.205869:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b003f614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+7:2351:x1875064614153088:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 Request processed in 5566us (5833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201332.205878:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:1.0:1788201332.209092:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201332.209276:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614153472 00000100:00100000:2.0:1788201332.209289:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614153472 00000100:00100000:2.0:1788201332.209371:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:2.0:1788201332.209382:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0035f87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+14:14489:x1875064614153472:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788201332.209494:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788176 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.209515:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788176 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.209529:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788176 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.209882:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78817d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.209896:0:14468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788145 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d326a expref: 15 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.209906:0:14468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78817d lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.209957:0:14468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788145 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d326a expref: 15 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.209973:0:14468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788145 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d326a expref: 15 pid: 14468 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201332.209990:0:14468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b003f614000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14468:1875064622519168:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788201332.210094:0:14468:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b001f8c1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201332.212913:0:14468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b003f614000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14468:1875064622519168:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788201332.212956:0:14468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78817d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201332.216059:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788201332.216349:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614153600 00000100:00100000:2.0:1788201332.216363:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614153600 00010000:00010000:2.0:1788201332.216417:0:14454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788145 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d326a expref: 16 pid: 14468 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201332.216472:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:2.0:1788201332.216484:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+16:2349:x1875064614153600:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201332.216505:0:14454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201332.216514:0:14454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788145 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d326a expref: 16 pid: 14468 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.216531:0:14454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788145 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d326a expref: 16 pid: 14468 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.216588:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b788145 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d326a expref: 16 pid: 14468 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.216610:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b0011cb3b00) 00010000:00010000:2.0:1788201332.216616:0:14454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78817d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.216627:0:14454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78817d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.216636:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78817d lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.216674:0:14454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201332.217023:0:14468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78817d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.217033:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78817d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201332.217319:0:14468:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788201332.217474:0:14468:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788201332.217518:0:14468:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788201332.217614:0:14468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004044dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14468:1875064622519296:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788201332.217890:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+18:2349:x1875064614153600:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 1404us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201332.217903:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:1.0:1788201332.219746:0:14468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201332.219815:0:14468:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0008b580c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201332.219868:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622519296 00000100:00100000:2.0:1788201332.219883:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622519296 00000100:00100000:2.0:1788201332.219948:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201332.219959:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14468:x1875064622519296:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788201332.220094:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14468:x1875064622519296:12345-0@lo:1000:mdt00_000.0 Request processed in 136us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201332.220102:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201332.220409:0:14468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004044dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14468:1875064622519296:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788201332.222597:0:14468:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788201332.222709:0:14468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004044dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14468:1875064622519424:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788201332.222775:0:14468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201332.222865:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064622519424 00000100:00100000:1.0:1788201332.222872:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064622519424 00000100:00100000:1.0:1788201332.222921:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201332.222932:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14468:x1875064622519424:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788201332.223099:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14468:x1875064622519424:12345-0@lo:1000:mdt00_000.0 Request processed in 169us (324us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788201332.223113:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201332.223172:0:14468:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b0018e7e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201332.223200:0:14468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004044dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14468:1875064622519424:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788201332.223233:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78817d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.223242:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78817d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.223250:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78817d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.223256:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201332.223260:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78817d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.223268:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78817d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.223284:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b0011cb3b00) 00010000:00010000:1.0:1788201332.223295:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201332.223300:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78817d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.223306:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1800/0x72011f792b78817d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.223340:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b7880d5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.223347:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b7880d5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.223352:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b7880d5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.223357:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676e800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1788201332.223360:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b7880d5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.223366:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b7880d5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.223375:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:1.0:1788201332.223378:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201332.223400:0:14468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b7880dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d324e expref: 18 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.223413:0:14468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b7880dc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d324e expref: 18 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.223423:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b7880dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d324e expref: 18 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.223476:0:14468:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b003c077000/0x72011f792b7880dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1f12878c8e1d324e expref: 18 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201332.223487:0:14468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b004044d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14468:1875064622519552:192.168.203.14@tcp:105: 00000100:00100000:1.0:1788201332.223537:0:14468:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b003f5a7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201332.231130:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201332.231284:0:14468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b004044d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14468:1875064622519552:192.168.203.14@tcp:105: 00010000:00010000:3.0:1788201332.231325:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b7880d5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.231354:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b000676e800/0x72011f792b7880d5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.231399:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b788184 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.231416:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b788184 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.231428:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b788184 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.231441:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b788184 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.231448:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b788184 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.231454:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b788184 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.231459:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d3800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201332.231463:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b788184 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.231471:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b788184 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.231483:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:3.0:1788201332.231486:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201332.231490:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b788184 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.231503:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aff030d3800/0x72011f792b788184 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.231514:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788176 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.231521:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788176 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.231528:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788176 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.231533:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1788201332.231536:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788176 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.231542:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788176 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.231551:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b0004dfdb00) 00010000:00010000:3.0:1788201332.231553:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788201332.231556:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788176 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.231561:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f1200/0x72011f792b788176 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201332.233200:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0035f87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+18:14489:x1875064614153472:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 23800us (24104us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788201332.233219:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 53 00000020:00080000:3.0:1788201332.233240:0:14468:0:(tgt_main.c:807:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788201332.233685:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614153728 00000100:00100000:0.0:1788201332.233697:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614153728 00000100:00100000:0.0:1788201332.234428:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:0.0:1788201332.234443:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0007197450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+18:14488:x1875064614153728:12345-192.168.203.14@tcp:49:dd.0 00000100:00100000:0.0:1788201332.234620:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0007197450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+18:14488:x1875064614153728:12345-192.168.203.14@tcp:49:dd.0 Request processed in 181us (3500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201332.234628:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00000040:00080000:0.0:1788201332.235094:0:14499:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788201332.235100:0:14499:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788201332.235778:0:14499:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788201332.235789:0:14499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788201332.241050:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201332.241126:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614153984 00000100:00100000:3.0:1788201332.241175:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614153984 00000100:00100000:3.0:1788201332.241249:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:3.0:1788201332.241262:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+18:14489:x1875064614153984:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788201332.242842:0:14472:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788201332.243086:0:14472:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788201332.243507:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b78818b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.243531:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b78818b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.243557:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b78818b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.243569:0:14472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b78818b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.243576:0:14472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b78818b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.243656:0:14472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b78818b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.243682:0:14472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201332.243731:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201332.243746:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b78818b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.243758:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f0600 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:1.0:1788201332.243762:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b78818b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.243771:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b78818b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.243789:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b0011cb3b00) 00010000:00010000:1.0:1788201332.243802:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201332.243807:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b78818b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.243812:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b001f8f0600/0x72011f792b78818b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201332.243831:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201332.243832:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201332.243834:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201332.244097:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+20:14489:x1875064614153984:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 2831us (3048us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788201332.244112:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000020:00080000:2.0:1788201332.244119:0:14472:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788201332.352628:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201332.352672:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201332.352784:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201332.352816:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201332.352830:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201332.352843:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201332.352859:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788201332.352877:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788201332.353735:0:15156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614154112 00000100:00100000:3.0:1788201332.353752:0:15156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614154112 00000100:00100000:3.0:1788201332.353834:0:15156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614154240 00000100:00100000:3.0:1788201332.353839:0:15156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614154240 00000100:00100000:3.0:1788201332.353856:0:15156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614154368 00000100:00100000:3.0:1788201332.353858:0:15156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614154368 00000100:00100000:3.0:1788201332.353872:0:15156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614154496 00000100:00100000:3.0:1788201332.353875:0:15156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614154496 00000100:00100000:3.0:1788201332.353887:0:15156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614154624 00000100:00100000:3.0:1788201332.353890:0:15156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614154624 00000100:00100000:3.0:1788201332.353902:0:15156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614154752 00000100:00100000:3.0:1788201332.353906:0:15156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614154752 00000100:00100000:3.0:1788201332.353918:0:15156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614155008 00000100:00100000:3.0:1788201332.353921:0:15156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614155008 00000100:00100000:3.0:1788201332.353933:0:15156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064614154880 00000100:00100000:3.0:1788201332.353935:0:15156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064614154880 00000100:00100000:3.0:1788201332.353957:0:15156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:3.0:1788201332.353970:0:15156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+14:2348:x1875064614154112:12345-192.168.203.14@tcp:4:dd.0 00002000:00010000:3.0:1788201332.354042:0:15156:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a95c973, atime: 0x6a95c972, ctime: 0x6a95c973, blocks: 0x1 00010000:00010000:3.0:1788201332.354055:0:15156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b788192 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.354076:0:15156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=411s v=(0 0) 00010000:00010000:3.0:1788201332.354098:0:15156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201332.354106:0:15156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b788192 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.354124:0:15156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b788192 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788201332.444022:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:0.0:1788201332.444041:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1788201332.444203:0:15156:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1788201332.444217:0:15156:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788201331 -> 1788201332 00002000:00010000:2.0:1788201332.444220:0:15156:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788201331 -> 1788201332 00002000:00010000:2.0:1788201332.444222:0:15156:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1788201332.444238:0:15156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b788192 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.444251:0:15156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b788192 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.444260:0:15156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b788192 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.444282:0:15156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d3e00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:2.0:1788201332.444287:0:15156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b788192 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.444296:0:15156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b788192 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.444314:0:15156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b788192 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.444321:0:15156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071c993be/0x72011f792b788192 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201332.444779:0:15156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+12:2348:x1875064614154112:12345-192.168.203.14@tcp:4:dd.0 Request processed in 90456us (91811us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788201332.444807:0:15156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:2.0:1788201332.444839:0:15156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:2.0:1788201332.444852:0:15156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+11:2349:x1875064614154240:12345-192.168.203.14@tcp:4:dd.0 00002000:00010000:2.0:1788201332.444896:0:15156:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 1048576, mtime: 0x6a95c974, atime: 0x6a95c972, ctime: 0x6a95c974, blocks: 0x803 00010000:00010000:2.0:1788201332.444903:0:15156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1bdc897/0x72011f792b788199 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.444916:0:15156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=411s v=(0 0) 00010000:00010000:2.0:1788201332.444921:0:15156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201332.444927:0:15156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1bdc897/0x72011f792b788199 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201332.444950:0:15156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1bdc897/0x72011f792b788199 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201332.495989:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:0.0:1788201332.496104:0:15156:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:0.0:1788201332.496111:0:15156:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:0.0:1788201332.496129:0:15156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1bdc897/0x72011f792b788199 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.496223:0:15156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1bdc897/0x72011f792b788199 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.496233:0:15156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1bdc897/0x72011f792b788199 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.496260:0:15156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b001f8f1200 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201332.496266:0:15156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1bdc897/0x72011f792b788199 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.496276:0:15156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1bdc897/0x72011f792b788199 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.496300:0:15156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1bdc897/0x72011f792b788199 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.496308:0:15156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1bdc897/0x72011f792b788199 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201332.496437:0:15156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+11:2349:x1875064614154240:12345-192.168.203.14@tcp:4:dd.0 Request processed in 51580us (143755us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788201332.496455:0:15156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:0.0:1788201332.496496:0:15156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:0.0:1788201332.496512:0:15156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+10:2349:x1875064614154368:12345-192.168.203.14@tcp:4:dd.0 00002000:00010000:0.0:1788201332.496562:0:15156:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6a95c974, atime: 0x6a95c972, ctime: 0x6a95c974, blocks: 0x1007 00010000:00010000:0.0:1788201332.496569:0:15156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.496582:0:15156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1788201332.496588:0:15156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201332.496602:0:15156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.496616:0:15156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201332.536858:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1788201332.536978:0:15156:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1788201332.536984:0:15156:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1788201332.537001:0:15156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.537016:0:15156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.537025:0:15156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.537034:0:15156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676ee00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201332.537040:0:15156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.537050:0:15156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.537073:0:15156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.537081:0:15156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201332.537359:0:15156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+10:2349:x1875064614154368:12345-192.168.203.14@tcp:4:dd.0 Request processed in 40847us (184577us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788201332.537370:0:15156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:0.0:1788201332.537407:0:15156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:0.0:1788201332.537421:0:15156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+9:2349:x1875064614154496:12345-192.168.203.14@tcp:4:dd.0 00002000:00010000:0.0:1788201332.537470:0:15156:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a95c974, atime: 0x6a95c972, ctime: 0x6a95c974, blocks: 0x1807 00010000:00010000:0.0:1788201332.537478:0:15156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003699b616/0x72011f792b7881a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.537491:0:15156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1788201332.537496:0:15156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201332.537503:0:15156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003699b616/0x72011f792b7881a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.537517:0:15156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003699b616/0x72011f792b7881a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201332.573253:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:3.0:1788201332.573330:0:15156:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:3.0:1788201332.573336:0:15156:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1788201332.573354:0:15156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003699b616/0x72011f792b7881a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.573369:0:15156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003699b616/0x72011f792b7881a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.573379:0:15156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003699b616/0x72011f792b7881a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.573388:0:15156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676f600 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:3.0:1788201332.573395:0:15156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003699b616/0x72011f792b7881a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.573406:0:15156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003699b616/0x72011f792b7881a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.573430:0:15156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003699b616/0x72011f792b7881a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.573456:0:15156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003699b616/0x72011f792b7881a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201332.573582:0:15156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+9:2349:x1875064614154496:12345-192.168.203.14@tcp:4:dd.0 Request processed in 36160us (220758us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788201332.573593:0:15156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:3.0:1788201332.573628:0:15156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:3.0:1788201332.573643:0:15156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+8:2349:x1875064614154624:12345-192.168.203.14@tcp:4:dd.0 00002000:00010000:3.0:1788201332.573692:0:15156:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a95c974, atime: 0x6a95c972, ctime: 0x6a95c974, blocks: 0x2007 00010000:00010000:3.0:1788201332.573699:0:15156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b7881ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.573714:0:15156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=411s v=(0 0) 00010000:00010000:3.0:1788201332.573719:0:15156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201332.573726:0:15156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b7881ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201332.573738:0:15156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b7881ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201332.634774:0:15156:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1788201332.634788:0:15156:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:0.0:1788201332.634817:0:15156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b7881ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.634835:0:15156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b7881ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.634867:0:15156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b7881ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.634877:0:15156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aff030d3800 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201332.634883:0:15156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b7881ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.634894:0:15156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b7881ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.634917:0:15156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b7881ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.634926:0:15156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e514679/0x72011f792b7881ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201332.635054:0:15156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+10:2349:x1875064614154624:12345-192.168.203.14@tcp:4:dd.0 Request processed in 61410us (282214us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1788201332.635067:0:15156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:0.0:1788201332.635118:0:15156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:0.0:1788201332.635252:0:15156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+9:2349:x1875064614154752:12345-192.168.203.14@tcp:4:dd.0 00002000:00010000:0.0:1788201332.635307:0:15156:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 5242880, mtime: 0x6a95c974, atime: 0x6a95c972, ctime: 0x6a95c974, blocks: 0x2807 00010000:00010000:0.0:1788201332.635316:0:15156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.635342:0:15156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1788201332.635347:0:15156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201332.635362:0:15156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.635379:0:15156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201332.635470:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00010000:00010000:0.0:1788201332.683963:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201332.697419:0:15156:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1788201332.697433:0:15156:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:0.0:1788201332.697451:0:15156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.697467:0:15156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.697478:0:15156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.697486:0:15156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676ee00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201332.697492:0:15156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.697502:0:15156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.697553:0:15156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.697560:0:15156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201332.697714:0:15156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+9:2349:x1875064614154752:12345-192.168.203.14@tcp:4:dd.0 Request processed in 62580us (344862us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788201332.697726:0:15156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:0.0:1788201332.697778:0:15156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:0.0:1788201332.697802:0:15156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+8:2348:x1875064614155008:12345-192.168.203.14@tcp:4:dd.0 00002000:00010000:0.0:1788201332.697863:0:15156:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 6291456, mtime: 0x6a95c974, atime: 0x6a95c972, ctime: 0x6a95c974, blocks: 0x3007 00010000:00010000:0.0:1788201332.697871:0:15156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008419ff18/0x72011f792b7881bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.697883:0:15156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1788201332.697888:0:15156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201332.697894:0:15156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008419ff18/0x72011f792b7881bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.697907:0:15156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008419ff18/0x72011f792b7881bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201332.698678:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00000001:00080000:3.0:1788201332.772274:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:0.0:1788201332.774035:0:15156:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:0.0:1788201332.774047:0:15156:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1788201332.774084:0:15156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008419ff18/0x72011f792b7881bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.774099:0:15156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008419ff18/0x72011f792b7881bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.774109:0:15156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008419ff18/0x72011f792b7881bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.774118:0:15156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676e800 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201332.774124:0:15156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008419ff18/0x72011f792b7881bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.774946:0:15156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008419ff18/0x72011f792b7881bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.774983:0:15156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008419ff18/0x72011f792b7881bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.774992:0:15156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008419ff18/0x72011f792b7881bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201332.775317:0:15156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+6:2348:x1875064614155008:12345-192.168.203.14@tcp:4:dd.0 Request processed in 77523us (422448us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788201332.775329:0:15156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:0.0:1788201332.775389:0:15156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:0.0:1788201332.775405:0:15156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b004044f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+5:2348:x1875064614154880:12345-192.168.203.14@tcp:4:dd.0 00002000:00010000:0.0:1788201332.775490:0:15156:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 7654321, mtime: 0x6a95c974, atime: 0x6a95c972, ctime: 0x6a95c974, blocks: 0x3807 00010000:00010000:0.0:1788201332.775499:0:15156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.775514:0:15156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1788201332.775519:0:15156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201332.775526:0:15156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.775540:0:15156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201332.839986:0:15156:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1788201332.840023:0:15156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.840039:0:15156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.840049:0:15156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.840058:0:15156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b000676ee00 already unused, calling callback (ffffffffc16c1fe0) 00010000:00010000:0.0:1788201332.840064:0:15156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.840074:0:15156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.840121:0:15156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201332.840129:0:15156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083eab710/0x72011f792b7881c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201332.840391:0:15156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b004044f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab3d4611-1671-4ca6-bd4c-255a5ad6dc3d+7:2348:x1875064614154880:12345-192.168.203.14@tcp:4:dd.0 Request processed in 64985us (487504us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788201332.840404:0:15156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000001:00080000:2.0:1788201332.840726:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:0.0:1788201333.710409:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201334.191522:0:16732:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788201334.731499:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28879 lines, 28879 kept, 0 dropped, 0 bad.